2023-07-16 06:10:50,927 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-16 06:10:51,185 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8 2023-07-16 06:10:51,185 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-16 06:10:51,186 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-16 06:10:51,228 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-16 06:10:51,485 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-16 06:10:51,485 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071, deleteOnExit=true 2023-07-16 06:10:51,486 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-16 06:10:51,486 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/test.cache.data in system properties and HBase conf 2023-07-16 06:10:51,487 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 06:10:51,488 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop.log.dir in system properties and HBase conf 2023-07-16 06:10:51,488 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 06:10:51,489 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 06:10:51,489 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 06:10:51,812 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-16 06:10:51,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 06:10:51,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 06:10:51,819 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 06:10:51,819 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 06:10:51,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 06:10:51,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 06:10:51,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 06:10:51,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 06:10:51,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 06:10:51,822 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/nfs.dump.dir in system properties and HBase conf 2023-07-16 06:10:51,822 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir in system properties and HBase conf 2023-07-16 06:10:51,822 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 06:10:51,823 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 06:10:51,823 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-16 06:10:52,407 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 06:10:52,413 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 06:10:52,691 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-16 06:10:52,874 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-16 06:10:52,890 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:10:52,924 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:10:52,960 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir/Jetty_localhost_33885_hdfs____.28nn29/webapp 2023-07-16 06:10:53,114 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33885 2023-07-16 06:10:53,160 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 06:10:53,161 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 06:10:53,701 WARN [Listener at localhost/37171] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 06:10:53,841 WARN [Listener at localhost/37171] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 06:10:53,866 WARN [Listener at localhost/37171] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:10:53,877 INFO [Listener at localhost/37171] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:10:53,884 INFO [Listener at localhost/37171] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir/Jetty_localhost_36297_datanode____mt4kc4/webapp 2023-07-16 06:10:54,022 INFO [Listener at localhost/37171] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36297 2023-07-16 06:10:54,584 WARN [Listener at localhost/43327] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 06:10:54,615 WARN [Listener at localhost/43327] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 06:10:54,622 WARN [Listener at localhost/43327] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:10:54,626 INFO [Listener at localhost/43327] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:10:54,631 INFO [Listener at localhost/43327] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir/Jetty_localhost_36603_datanode____43q4pp/webapp 2023-07-16 06:10:54,760 INFO [Listener at localhost/43327] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36603 2023-07-16 06:10:54,791 WARN [Listener at localhost/44435] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 06:10:54,819 WARN [Listener at localhost/44435] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 06:10:54,827 WARN [Listener at localhost/44435] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:10:54,828 INFO [Listener at localhost/44435] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:10:54,834 INFO [Listener at localhost/44435] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir/Jetty_localhost_33373_datanode____.wuxl7u/webapp 2023-07-16 06:10:54,972 INFO [Listener at localhost/44435] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33373 2023-07-16 06:10:55,000 WARN [Listener at localhost/44595] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 06:10:55,336 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf5996c99084c3e33: Processing first storage report for DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c from datanode 40e26610-bd59-4c2a-8529-7ce6227e7c91 2023-07-16 06:10:55,337 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf5996c99084c3e33: from storage DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c node DatanodeRegistration(127.0.0.1:33581, datanodeUuid=40e26610-bd59-4c2a-8529-7ce6227e7c91, infoPort=45779, infoSecurePort=0, ipcPort=43327, storageInfo=lv=-57;cid=testClusterID;nsid=319310316;c=1689487852489), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,338 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x664e06f4c2e92e78: Processing first storage report for DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5 from datanode cf5be3f6-2b54-442b-b79c-b547a8d977c6 2023-07-16 06:10:55,338 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x664e06f4c2e92e78: from storage DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5 node DatanodeRegistration(127.0.0.1:35837, datanodeUuid=cf5be3f6-2b54-442b-b79c-b547a8d977c6, infoPort=39703, infoSecurePort=0, ipcPort=44595, storageInfo=lv=-57;cid=testClusterID;nsid=319310316;c=1689487852489), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,338 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf5996c99084c3e33: Processing first storage report for DS-2f1f6c64-2bab-452e-a8df-a180a8b78a9c from datanode 40e26610-bd59-4c2a-8529-7ce6227e7c91 2023-07-16 06:10:55,338 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf5996c99084c3e33: from storage DS-2f1f6c64-2bab-452e-a8df-a180a8b78a9c node DatanodeRegistration(127.0.0.1:33581, datanodeUuid=40e26610-bd59-4c2a-8529-7ce6227e7c91, infoPort=45779, infoSecurePort=0, ipcPort=43327, storageInfo=lv=-57;cid=testClusterID;nsid=319310316;c=1689487852489), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,338 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x664e06f4c2e92e78: Processing first storage report for DS-f4cff5fc-1d1d-4628-bfe8-632d2a2f9002 from datanode cf5be3f6-2b54-442b-b79c-b547a8d977c6 2023-07-16 06:10:55,338 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x664e06f4c2e92e78: from storage DS-f4cff5fc-1d1d-4628-bfe8-632d2a2f9002 node DatanodeRegistration(127.0.0.1:35837, datanodeUuid=cf5be3f6-2b54-442b-b79c-b547a8d977c6, infoPort=39703, infoSecurePort=0, ipcPort=44595, storageInfo=lv=-57;cid=testClusterID;nsid=319310316;c=1689487852489), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,339 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4abb13d97f83f54d: Processing first storage report for DS-c5eee385-4954-44db-a224-0648da1bf519 from datanode caf986c0-6aef-46e6-8949-237c83b14d27 2023-07-16 06:10:55,339 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4abb13d97f83f54d: from storage DS-c5eee385-4954-44db-a224-0648da1bf519 node DatanodeRegistration(127.0.0.1:39397, datanodeUuid=caf986c0-6aef-46e6-8949-237c83b14d27, infoPort=37613, infoSecurePort=0, ipcPort=44435, storageInfo=lv=-57;cid=testClusterID;nsid=319310316;c=1689487852489), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,339 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4abb13d97f83f54d: Processing first storage report for DS-8122fb96-3ef4-464f-a5da-9d5ab8488ede from datanode caf986c0-6aef-46e6-8949-237c83b14d27 2023-07-16 06:10:55,339 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4abb13d97f83f54d: from storage DS-8122fb96-3ef4-464f-a5da-9d5ab8488ede node DatanodeRegistration(127.0.0.1:39397, datanodeUuid=caf986c0-6aef-46e6-8949-237c83b14d27, infoPort=37613, infoSecurePort=0, ipcPort=44435, storageInfo=lv=-57;cid=testClusterID;nsid=319310316;c=1689487852489), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 06:10:55,566 DEBUG [Listener at localhost/44595] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8 2023-07-16 06:10:55,656 INFO [Listener at localhost/44595] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/zookeeper_0, clientPort=58206, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-16 06:10:55,678 INFO [Listener at localhost/44595] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58206 2023-07-16 06:10:55,691 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:55,693 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:56,371 INFO [Listener at localhost/44595] util.FSUtils(471): Created version file at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 with version=8 2023-07-16 06:10:56,371 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/hbase-staging 2023-07-16 06:10:56,717 INFO [Listener at localhost/44595] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-16 06:10:57,299 INFO [Listener at localhost/44595] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 06:10:57,363 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:57,364 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:57,364 INFO [Listener at localhost/44595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 06:10:57,379 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:57,379 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 06:10:57,572 INFO [Listener at localhost/44595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 06:10:57,655 DEBUG [Listener at localhost/44595] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-16 06:10:57,771 INFO [Listener at localhost/44595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46097 2023-07-16 06:10:57,784 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:57,786 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:57,808 INFO [Listener at localhost/44595] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46097 connecting to ZooKeeper ensemble=127.0.0.1:58206 2023-07-16 06:10:57,860 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:460970x0, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 06:10:57,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46097-0x1016cc153130000 connected 2023-07-16 06:10:57,897 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:10:57,898 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:10:57,917 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 06:10:57,930 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46097 2023-07-16 06:10:57,930 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46097 2023-07-16 06:10:57,932 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46097 2023-07-16 06:10:57,934 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46097 2023-07-16 06:10:57,934 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46097 2023-07-16 06:10:57,943 INFO [Listener at localhost/44595] master.HMaster(444): hbase.rootdir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2, hbase.cluster.distributed=false 2023-07-16 06:10:58,034 INFO [Listener at localhost/44595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 06:10:58,035 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,035 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,035 INFO [Listener at localhost/44595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 06:10:58,036 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,036 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 06:10:58,043 INFO [Listener at localhost/44595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 06:10:58,047 INFO [Listener at localhost/44595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41391 2023-07-16 06:10:58,051 INFO [Listener at localhost/44595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 06:10:58,060 INFO [Listener at localhost/44595] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 06:10:58,062 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,065 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,067 INFO [Listener at localhost/44595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41391 connecting to ZooKeeper ensemble=127.0.0.1:58206 2023-07-16 06:10:58,077 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:413910x0, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 06:10:58,079 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:413910x0, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:10:58,087 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:413910x0, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:10:58,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41391-0x1016cc153130001 connected 2023-07-16 06:10:58,090 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 06:10:58,096 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41391 2023-07-16 06:10:58,098 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41391 2023-07-16 06:10:58,098 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41391 2023-07-16 06:10:58,102 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41391 2023-07-16 06:10:58,102 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41391 2023-07-16 06:10:58,121 INFO [Listener at localhost/44595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 06:10:58,122 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,122 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,123 INFO [Listener at localhost/44595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 06:10:58,123 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,123 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 06:10:58,123 INFO [Listener at localhost/44595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 06:10:58,128 INFO [Listener at localhost/44595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34953 2023-07-16 06:10:58,128 INFO [Listener at localhost/44595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 06:10:58,135 INFO [Listener at localhost/44595] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 06:10:58,136 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,138 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,140 INFO [Listener at localhost/44595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34953 connecting to ZooKeeper ensemble=127.0.0.1:58206 2023-07-16 06:10:58,147 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:349530x0, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 06:10:58,148 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:349530x0, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:10:58,149 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:349530x0, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:10:58,149 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:349530x0, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 06:10:58,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34953-0x1016cc153130002 connected 2023-07-16 06:10:58,158 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34953 2023-07-16 06:10:58,159 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34953 2023-07-16 06:10:58,160 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34953 2023-07-16 06:10:58,166 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34953 2023-07-16 06:10:58,167 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34953 2023-07-16 06:10:58,185 INFO [Listener at localhost/44595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 06:10:58,186 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,186 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,186 INFO [Listener at localhost/44595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 06:10:58,186 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 06:10:58,186 INFO [Listener at localhost/44595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 06:10:58,187 INFO [Listener at localhost/44595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 06:10:58,188 INFO [Listener at localhost/44595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35311 2023-07-16 06:10:58,189 INFO [Listener at localhost/44595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 06:10:58,190 INFO [Listener at localhost/44595] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 06:10:58,191 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,193 INFO [Listener at localhost/44595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,196 INFO [Listener at localhost/44595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35311 connecting to ZooKeeper ensemble=127.0.0.1:58206 2023-07-16 06:10:58,211 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:353110x0, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 06:10:58,212 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:353110x0, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:10:58,213 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:353110x0, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:10:58,214 DEBUG [Listener at localhost/44595] zookeeper.ZKUtil(164): regionserver:353110x0, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 06:10:58,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35311-0x1016cc153130003 connected 2023-07-16 06:10:58,223 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35311 2023-07-16 06:10:58,226 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35311 2023-07-16 06:10:58,227 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35311 2023-07-16 06:10:58,229 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35311 2023-07-16 06:10:58,230 DEBUG [Listener at localhost/44595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35311 2023-07-16 06:10:58,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:10:58,244 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 06:10:58,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:10:58,271 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 06:10:58,271 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 06:10:58,272 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:58,271 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 06:10:58,271 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 06:10:58,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 06:10:58,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 06:10:58,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46097,1689487856540 from backup master directory 2023-07-16 06:10:58,282 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:10:58,282 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 06:10:58,283 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 06:10:58,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:10:58,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-16 06:10:58,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-16 06:10:58,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/hbase.id with ID: 0e9a4a0a-a8fc-4474-8708-e8dd5a1d074a 2023-07-16 06:10:58,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 06:10:58,510 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:58,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5523a838 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:10:58,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5034a309, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:10:58,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:10:58,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-16 06:10:58,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-16 06:10:58,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-16 06:10:58,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 06:10:58,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 06:10:58,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:10:58,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store-tmp 2023-07-16 06:10:58,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:10:58,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 06:10:58,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:10:58,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:10:58,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 06:10:58,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:10:58,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:10:58,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 06:10:58,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/WALs/jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:10:58,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46097%2C1689487856540, suffix=, logDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/WALs/jenkins-hbase4.apache.org,46097,1689487856540, archiveDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/oldWALs, maxLogs=10 2023-07-16 06:10:58,902 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK] 2023-07-16 06:10:58,902 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK] 2023-07-16 06:10:58,906 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK] 2023-07-16 06:10:58,912 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-16 06:10:59,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/WALs/jenkins-hbase4.apache.org,46097,1689487856540/jenkins-hbase4.apache.org%2C46097%2C1689487856540.1689487858829 2023-07-16 06:10:59,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK], DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK], DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK]] 2023-07-16 06:10:59,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:10:59,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:10:59,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,113 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,122 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-16 06:10:59,163 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-16 06:10:59,180 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:10:59,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 06:10:59,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:10:59,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69841687, jitterRate=0.040722236037254333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:10:59,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 06:10:59,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-16 06:10:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-16 06:10:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-16 06:10:59,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-16 06:10:59,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-16 06:10:59,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-16 06:10:59,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-16 06:10:59,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-16 06:10:59,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-16 06:10:59,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-16 06:10:59,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-16 06:10:59,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-16 06:10:59,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-16 06:10:59,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-16 06:10:59,399 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:59,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-16 06:10:59,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-16 06:10:59,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-16 06:10:59,428 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 06:10:59,428 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 06:10:59,428 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 06:10:59,428 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 06:10:59,428 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:59,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46097,1689487856540, sessionid=0x1016cc153130000, setting cluster-up flag (Was=false) 2023-07-16 06:10:59,453 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:59,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-16 06:10:59,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:10:59,480 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:10:59,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-16 06:10:59,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:10:59,492 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp 2023-07-16 06:10:59,547 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(951): ClusterId : 0e9a4a0a-a8fc-4474-8708-e8dd5a1d074a 2023-07-16 06:10:59,572 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(951): ClusterId : 0e9a4a0a-a8fc-4474-8708-e8dd5a1d074a 2023-07-16 06:10:59,574 INFO [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(951): ClusterId : 0e9a4a0a-a8fc-4474-8708-e8dd5a1d074a 2023-07-16 06:10:59,577 DEBUG [RS:0;jenkins-hbase4:41391] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 06:10:59,577 DEBUG [RS:1;jenkins-hbase4:34953] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 06:10:59,577 DEBUG [RS:2;jenkins-hbase4:35311] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 06:10:59,587 DEBUG [RS:0;jenkins-hbase4:41391] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 06:10:59,587 DEBUG [RS:0;jenkins-hbase4:41391] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 06:10:59,595 DEBUG [RS:2;jenkins-hbase4:35311] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 06:10:59,595 DEBUG [RS:2;jenkins-hbase4:35311] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 06:10:59,595 DEBUG [RS:1;jenkins-hbase4:34953] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 06:10:59,596 DEBUG [RS:1;jenkins-hbase4:34953] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 06:10:59,600 DEBUG [RS:1;jenkins-hbase4:34953] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 06:10:59,600 DEBUG [RS:0;jenkins-hbase4:41391] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 06:10:59,601 DEBUG [RS:1;jenkins-hbase4:34953] zookeeper.ReadOnlyZKClient(139): Connect 0x612c5185 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:10:59,603 DEBUG [RS:0;jenkins-hbase4:41391] zookeeper.ReadOnlyZKClient(139): Connect 0x26498b02 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:10:59,615 DEBUG [RS:2;jenkins-hbase4:35311] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 06:10:59,620 DEBUG [RS:2;jenkins-hbase4:35311] zookeeper.ReadOnlyZKClient(139): Connect 0x3c60ef52 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:10:59,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-16 06:10:59,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:10:59,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-16 06:10:59,648 DEBUG [RS:1;jenkins-hbase4:34953] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@242ec3c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:10:59,649 DEBUG [RS:1;jenkins-hbase4:34953] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ee74626, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 06:10:59,652 DEBUG [RS:2;jenkins-hbase4:35311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32a706ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:10:59,652 DEBUG [RS:2;jenkins-hbase4:35311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36988422, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 06:10:59,653 DEBUG [RS:0;jenkins-hbase4:41391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f13b43c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:10:59,654 DEBUG [RS:0;jenkins-hbase4:41391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8d4ed81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 06:10:59,682 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34953 2023-07-16 06:10:59,683 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:35311 2023-07-16 06:10:59,684 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41391 2023-07-16 06:10:59,689 INFO [RS:1;jenkins-hbase4:34953] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 06:10:59,689 INFO [RS:1;jenkins-hbase4:34953] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 06:10:59,689 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 06:10:59,689 INFO [RS:0;jenkins-hbase4:41391] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 06:10:59,689 INFO [RS:2;jenkins-hbase4:35311] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 06:10:59,690 INFO [RS:2;jenkins-hbase4:35311] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 06:10:59,690 INFO [RS:0;jenkins-hbase4:41391] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 06:10:59,691 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 06:10:59,691 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 06:10:59,691 INFO [RS:2;jenkins-hbase4:35311] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:10:59,695 INFO [RS:0;jenkins-hbase4:41391] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:10:59,695 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 06:10:59,695 INFO [RS:1;jenkins-hbase4:34953] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:10:59,695 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 06:10:59,695 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 06:10:59,699 INFO [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46097,1689487856540 with isa=jenkins-hbase4.apache.org/172.31.14.131:35311, startcode=1689487858185 2023-07-16 06:10:59,699 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46097,1689487856540 with isa=jenkins-hbase4.apache.org/172.31.14.131:34953, startcode=1689487858121 2023-07-16 06:10:59,699 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46097,1689487856540 with isa=jenkins-hbase4.apache.org/172.31.14.131:41391, startcode=1689487858033 2023-07-16 06:10:59,724 DEBUG [RS:1;jenkins-hbase4:34953] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 06:10:59,724 DEBUG [RS:0;jenkins-hbase4:41391] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 06:10:59,724 DEBUG [RS:2;jenkins-hbase4:35311] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 06:10:59,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-16 06:10:59,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 06:10:59,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 06:10:59,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 06:10:59,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 06:10:59,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-16 06:10:59,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:10:59,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 06:10:59,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:10:59,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689487889848 2023-07-16 06:10:59,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-16 06:10:59,851 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47033, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 06:10:59,851 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49799, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 06:10:59,851 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42611, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 06:10:59,853 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 06:10:59,854 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-16 06:10:59,861 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 06:10:59,862 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 06:10:59,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-16 06:10:59,879 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 06:10:59,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-16 06:10:59,879 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 06:10:59,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-16 06:10:59,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-16 06:10:59,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-16 06:10:59,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 06:10:59,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-16 06:10:59,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-16 06:10:59,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-16 06:10:59,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-16 06:10:59,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-16 06:10:59,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689487859906,5,FailOnTimeoutGroup] 2023-07-16 06:10:59,908 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 06:10:59,908 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 06:10:59,908 WARN [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 06:10:59,908 WARN [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 06:10:59,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689487859907,5,FailOnTimeoutGroup] 2023-07-16 06:10:59,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 06:10:59,912 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 06:10:59,912 WARN [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 06:10:59,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-16 06:10:59,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-16 06:10:59,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-16 06:10:59,971 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 06:10:59,973 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 06:10:59,973 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:00,012 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46097,1689487856540 with isa=jenkins-hbase4.apache.org/172.31.14.131:34953, startcode=1689487858121 2023-07-16 06:11:00,012 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46097,1689487856540 with isa=jenkins-hbase4.apache.org/172.31.14.131:41391, startcode=1689487858033 2023-07-16 06:11:00,015 INFO [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46097,1689487856540 with isa=jenkins-hbase4.apache.org/172.31.14.131:35311, startcode=1689487858185 2023-07-16 06:11:00,027 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46097] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,045 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46097] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:00,046 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46097] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:00,050 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:00,050 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:00,050 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:00,050 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37171 2023-07-16 06:11:00,050 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37171 2023-07-16 06:11:00,050 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 06:11:00,050 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37171 2023-07-16 06:11:00,050 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 06:11:00,051 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 06:11:00,058 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:11:00,062 DEBUG [RS:1;jenkins-hbase4:34953] zookeeper.ZKUtil(162): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:00,063 WARN [RS:1;jenkins-hbase4:34953] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 06:11:00,065 INFO [RS:1;jenkins-hbase4:34953] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:11:00,066 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:00,066 DEBUG [RS:0;jenkins-hbase4:41391] zookeeper.ZKUtil(162): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,068 DEBUG [RS:2;jenkins-hbase4:35311] zookeeper.ZKUtil(162): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:00,070 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:00,066 WARN [RS:0;jenkins-hbase4:41391] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 06:11:00,073 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34953,1689487858121] 2023-07-16 06:11:00,068 WARN [RS:2;jenkins-hbase4:35311] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 06:11:00,074 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35311,1689487858185] 2023-07-16 06:11:00,074 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41391,1689487858033] 2023-07-16 06:11:00,073 INFO [RS:0;jenkins-hbase4:41391] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:11:00,075 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,074 INFO [RS:2;jenkins-hbase4:35311] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:11:00,076 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 06:11:00,076 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:00,082 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/info 2023-07-16 06:11:00,083 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 06:11:00,084 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 06:11:00,086 DEBUG [RS:0;jenkins-hbase4:41391] zookeeper.ZKUtil(162): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:00,087 DEBUG [RS:1;jenkins-hbase4:34953] zookeeper.ZKUtil(162): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:00,087 DEBUG [RS:0;jenkins-hbase4:41391] zookeeper.ZKUtil(162): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:00,087 DEBUG [RS:2;jenkins-hbase4:35311] zookeeper.ZKUtil(162): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:00,088 DEBUG [RS:0;jenkins-hbase4:41391] zookeeper.ZKUtil(162): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,088 DEBUG [RS:1;jenkins-hbase4:34953] zookeeper.ZKUtil(162): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:00,088 DEBUG [RS:2;jenkins-hbase4:35311] zookeeper.ZKUtil(162): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:00,089 DEBUG [RS:2;jenkins-hbase4:35311] zookeeper.ZKUtil(162): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,089 DEBUG [RS:1;jenkins-hbase4:34953] zookeeper.ZKUtil(162): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/rep_barrier 2023-07-16 06:11:00,104 DEBUG [RS:2;jenkins-hbase4:35311] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 06:11:00,106 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 06:11:00,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 06:11:00,111 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/table 2023-07-16 06:11:00,112 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 06:11:00,114 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,104 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 06:11:00,104 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 06:11:00,119 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740 2023-07-16 06:11:00,119 INFO [RS:2;jenkins-hbase4:35311] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 06:11:00,119 INFO [RS:1;jenkins-hbase4:34953] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 06:11:00,120 INFO [RS:0;jenkins-hbase4:41391] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 06:11:00,121 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740 2023-07-16 06:11:00,125 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 06:11:00,127 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 06:11:00,158 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:00,159 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60661060, jitterRate=-0.0960797667503357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 06:11:00,159 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 06:11:00,159 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 06:11:00,160 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 06:11:00,160 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 06:11:00,160 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 06:11:00,160 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 06:11:00,162 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 06:11:00,164 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 06:11:00,175 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 06:11:00,175 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-16 06:11:00,184 INFO [RS:2;jenkins-hbase4:35311] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 06:11:00,186 INFO [RS:1;jenkins-hbase4:34953] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 06:11:00,186 INFO [RS:0;jenkins-hbase4:41391] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 06:11:00,191 INFO [RS:2;jenkins-hbase4:35311] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 06:11:00,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-16 06:11:00,191 INFO [RS:1;jenkins-hbase4:34953] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 06:11:00,191 INFO [RS:2;jenkins-hbase4:35311] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,192 INFO [RS:1;jenkins-hbase4:34953] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,192 INFO [RS:0;jenkins-hbase4:41391] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 06:11:00,193 INFO [RS:0;jenkins-hbase4:41391] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,193 INFO [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 06:11:00,194 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 06:11:00,194 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 06:11:00,204 INFO [RS:2;jenkins-hbase4:35311] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,204 INFO [RS:1;jenkins-hbase4:34953] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,204 INFO [RS:0;jenkins-hbase4:41391] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,204 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,204 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,205 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 06:11:00,206 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 06:11:00,205 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:0;jenkins-hbase4:41391] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:1;jenkins-hbase4:34953] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,206 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,209 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 06:11:00,209 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,209 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,209 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,210 DEBUG [RS:2;jenkins-hbase4:35311] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 06:11:00,218 INFO [RS:0;jenkins-hbase4:41391] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,220 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-16 06:11:00,220 INFO [RS:0;jenkins-hbase4:41391] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,221 INFO [RS:0;jenkins-hbase4:41391] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,222 INFO [RS:2;jenkins-hbase4:35311] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,223 INFO [RS:2;jenkins-hbase4:35311] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,223 INFO [RS:2;jenkins-hbase4:35311] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,244 INFO [RS:1;jenkins-hbase4:34953] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,244 INFO [RS:1;jenkins-hbase4:34953] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,244 INFO [RS:1;jenkins-hbase4:34953] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,251 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-16 06:11:00,259 INFO [RS:2;jenkins-hbase4:35311] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 06:11:00,261 INFO [RS:1;jenkins-hbase4:34953] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 06:11:00,264 INFO [RS:2;jenkins-hbase4:35311] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35311,1689487858185-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,265 INFO [RS:1;jenkins-hbase4:34953] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34953,1689487858121-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,266 INFO [RS:0;jenkins-hbase4:41391] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 06:11:00,266 INFO [RS:0;jenkins-hbase4:41391] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41391,1689487858033-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:00,338 INFO [RS:1;jenkins-hbase4:34953] regionserver.Replication(203): jenkins-hbase4.apache.org,34953,1689487858121 started 2023-07-16 06:11:00,339 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34953,1689487858121, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34953, sessionid=0x1016cc153130002 2023-07-16 06:11:00,339 INFO [RS:2;jenkins-hbase4:35311] regionserver.Replication(203): jenkins-hbase4.apache.org,35311,1689487858185 started 2023-07-16 06:11:00,339 INFO [RS:0;jenkins-hbase4:41391] regionserver.Replication(203): jenkins-hbase4.apache.org,41391,1689487858033 started 2023-07-16 06:11:00,339 DEBUG [RS:1;jenkins-hbase4:34953] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 06:11:00,339 INFO [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35311,1689487858185, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35311, sessionid=0x1016cc153130003 2023-07-16 06:11:00,339 DEBUG [RS:1;jenkins-hbase4:34953] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:00,340 DEBUG [RS:2;jenkins-hbase4:35311] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 06:11:00,339 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41391,1689487858033, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41391, sessionid=0x1016cc153130001 2023-07-16 06:11:00,340 DEBUG [RS:2;jenkins-hbase4:35311] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:00,340 DEBUG [RS:2;jenkins-hbase4:35311] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35311,1689487858185' 2023-07-16 06:11:00,341 DEBUG [RS:2;jenkins-hbase4:35311] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 06:11:00,340 DEBUG [RS:1;jenkins-hbase4:34953] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34953,1689487858121' 2023-07-16 06:11:00,340 DEBUG [RS:0;jenkins-hbase4:41391] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 06:11:00,342 DEBUG [RS:1;jenkins-hbase4:34953] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 06:11:00,342 DEBUG [RS:0;jenkins-hbase4:41391] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,342 DEBUG [RS:0;jenkins-hbase4:41391] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41391,1689487858033' 2023-07-16 06:11:00,343 DEBUG [RS:0;jenkins-hbase4:41391] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 06:11:00,343 DEBUG [RS:1;jenkins-hbase4:34953] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 06:11:00,343 DEBUG [RS:0;jenkins-hbase4:41391] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 06:11:00,344 DEBUG [RS:1;jenkins-hbase4:34953] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 06:11:00,344 DEBUG [RS:0;jenkins-hbase4:41391] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 06:11:00,344 DEBUG [RS:1;jenkins-hbase4:34953] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 06:11:00,344 DEBUG [RS:0;jenkins-hbase4:41391] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 06:11:00,344 DEBUG [RS:1;jenkins-hbase4:34953] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:00,345 DEBUG [RS:2;jenkins-hbase4:35311] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 06:11:00,344 DEBUG [RS:0;jenkins-hbase4:41391] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,345 DEBUG [RS:1;jenkins-hbase4:34953] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34953,1689487858121' 2023-07-16 06:11:00,345 DEBUG [RS:1;jenkins-hbase4:34953] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:00,345 DEBUG [RS:0;jenkins-hbase4:41391] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41391,1689487858033' 2023-07-16 06:11:00,345 DEBUG [RS:0;jenkins-hbase4:41391] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:00,346 DEBUG [RS:1;jenkins-hbase4:34953] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:00,346 DEBUG [RS:0;jenkins-hbase4:41391] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:00,347 DEBUG [RS:1;jenkins-hbase4:34953] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 06:11:00,347 INFO [RS:1;jenkins-hbase4:34953] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 06:11:00,347 INFO [RS:1;jenkins-hbase4:34953] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 06:11:00,346 DEBUG [RS:2;jenkins-hbase4:35311] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 06:11:00,347 DEBUG [RS:0;jenkins-hbase4:41391] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 06:11:00,347 DEBUG [RS:2;jenkins-hbase4:35311] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 06:11:00,348 INFO [RS:0;jenkins-hbase4:41391] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 06:11:00,348 DEBUG [RS:2;jenkins-hbase4:35311] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:00,348 INFO [RS:0;jenkins-hbase4:41391] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 06:11:00,349 DEBUG [RS:2;jenkins-hbase4:35311] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35311,1689487858185' 2023-07-16 06:11:00,349 DEBUG [RS:2;jenkins-hbase4:35311] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:00,349 DEBUG [RS:2;jenkins-hbase4:35311] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:00,350 DEBUG [RS:2;jenkins-hbase4:35311] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 06:11:00,350 INFO [RS:2;jenkins-hbase4:35311] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 06:11:00,350 INFO [RS:2;jenkins-hbase4:35311] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 06:11:00,403 DEBUG [jenkins-hbase4:46097] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-16 06:11:00,410 DEBUG [jenkins-hbase4:46097] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:00,417 DEBUG [jenkins-hbase4:46097] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:00,417 DEBUG [jenkins-hbase4:46097] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:00,417 DEBUG [jenkins-hbase4:46097] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:00,417 DEBUG [jenkins-hbase4:46097] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:00,421 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41391,1689487858033, state=OPENING 2023-07-16 06:11:00,432 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-16 06:11:00,433 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:11:00,434 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 06:11:00,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:11:00,467 INFO [RS:0;jenkins-hbase4:41391] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41391%2C1689487858033, suffix=, logDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,41391,1689487858033, archiveDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/oldWALs, maxLogs=32 2023-07-16 06:11:00,468 INFO [RS:2;jenkins-hbase4:35311] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35311%2C1689487858185, suffix=, logDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,35311,1689487858185, archiveDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/oldWALs, maxLogs=32 2023-07-16 06:11:00,469 INFO [RS:1;jenkins-hbase4:34953] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34953%2C1689487858121, suffix=, logDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,34953,1689487858121, archiveDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/oldWALs, maxLogs=32 2023-07-16 06:11:00,501 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK] 2023-07-16 06:11:00,501 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK] 2023-07-16 06:11:00,501 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK] 2023-07-16 06:11:00,512 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK] 2023-07-16 06:11:00,512 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK] 2023-07-16 06:11:00,513 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK] 2023-07-16 06:11:00,523 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK] 2023-07-16 06:11:00,523 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK] 2023-07-16 06:11:00,523 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK] 2023-07-16 06:11:00,528 INFO [RS:0;jenkins-hbase4:41391] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,41391,1689487858033/jenkins-hbase4.apache.org%2C41391%2C1689487858033.1689487860476 2023-07-16 06:11:00,539 INFO [RS:1;jenkins-hbase4:34953] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,34953,1689487858121/jenkins-hbase4.apache.org%2C34953%2C1689487858121.1689487860477 2023-07-16 06:11:00,541 DEBUG [RS:0;jenkins-hbase4:41391] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK], DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK], DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK]] 2023-07-16 06:11:00,542 DEBUG [RS:1;jenkins-hbase4:34953] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK], DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK], DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK]] 2023-07-16 06:11:00,547 INFO [RS:2;jenkins-hbase4:35311] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,35311,1689487858185/jenkins-hbase4.apache.org%2C35311%2C1689487858185.1689487860478 2023-07-16 06:11:00,547 DEBUG [RS:2;jenkins-hbase4:35311] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK], DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK], DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK]] 2023-07-16 06:11:00,650 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:00,652 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:11:00,656 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:11:00,694 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-16 06:11:00,694 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 06:11:00,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41391%2C1689487858033.meta, suffix=.meta, logDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,41391,1689487858033, archiveDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/oldWALs, maxLogs=32 2023-07-16 06:11:00,729 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK] 2023-07-16 06:11:00,735 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK] 2023-07-16 06:11:00,735 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK] 2023-07-16 06:11:00,745 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/WALs/jenkins-hbase4.apache.org,41391,1689487858033/jenkins-hbase4.apache.org%2C41391%2C1689487858033.meta.1689487860701.meta 2023-07-16 06:11:00,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39397,DS-c5eee385-4954-44db-a224-0648da1bf519,DISK], DatanodeInfoWithStorage[127.0.0.1:35837,DS-3b3c4f38-2938-4fb1-b192-4f557c69cfa5,DISK], DatanodeInfoWithStorage[127.0.0.1:33581,DS-5bf57a80-f8fd-49f6-b7c7-2f88aa904f5c,DISK]] 2023-07-16 06:11:00,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:11:00,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-16 06:11:00,749 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:00,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-16 06:11:00,752 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-16 06:11:00,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-16 06:11:00,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-16 06:11:00,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:00,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-16 06:11:00,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-16 06:11:00,772 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 06:11:00,774 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/info 2023-07-16 06:11:00,774 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/info 2023-07-16 06:11:00,775 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 06:11:00,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 06:11:00,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/rep_barrier 2023-07-16 06:11:00,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/rep_barrier 2023-07-16 06:11:00,781 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 06:11:00,784 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,785 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 06:11:00,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/table 2023-07-16 06:11:00,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/table 2023-07-16 06:11:00,787 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 06:11:00,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:00,791 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740 2023-07-16 06:11:00,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740 2023-07-16 06:11:00,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 06:11:00,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 06:11:00,805 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67738271, jitterRate=0.009378895163536072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 06:11:00,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 06:11:00,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689487860640 2023-07-16 06:11:00,848 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-16 06:11:00,849 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-16 06:11:00,850 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41391,1689487858033, state=OPEN 2023-07-16 06:11:00,854 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-16 06:11:00,854 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 06:11:00,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-16 06:11:00,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41391,1689487858033 in 409 msec 2023-07-16 06:11:00,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-16 06:11:00,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 672 msec 2023-07-16 06:11:00,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2160 sec 2023-07-16 06:11:00,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689487860876, completionTime=-1 2023-07-16 06:11:00,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-16 06:11:00,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-16 06:11:00,983 DEBUG [hconnection-0x65d1f25d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:00,988 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:01,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-16 06:11:01,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689487921020 2023-07-16 06:11:01,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689487981020 2023-07-16 06:11:01,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 144 msec 2023-07-16 06:11:01,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46097,1689487856540-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46097,1689487856540-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46097,1689487856540-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46097, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-16 06:11:01,065 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-16 06:11:01,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-16 06:11:01,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 06:11:01,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-16 06:11:01,096 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:01,101 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:01,133 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,137 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07 empty. 2023-07-16 06:11:01,138 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,138 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-16 06:11:01,192 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:01,195 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c99c0fe6a51f54b7c94b625acb1d0d07, NAME => 'hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:11:01,219 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:01,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c99c0fe6a51f54b7c94b625acb1d0d07, disabling compactions & flushes 2023-07-16 06:11:01,220 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:11:01,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:11:01,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. after waiting 0 ms 2023-07-16 06:11:01,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:11:01,221 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:11:01,221 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c99c0fe6a51f54b7c94b625acb1d0d07: 2023-07-16 06:11:01,233 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:01,254 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689487861237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487861237"}]},"ts":"1689487861237"} 2023-07-16 06:11:01,292 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 06:11:01,294 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:01,300 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487861295"}]},"ts":"1689487861295"} 2023-07-16 06:11:01,308 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-16 06:11:01,314 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:01,315 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:01,315 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:01,315 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:01,315 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:01,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c99c0fe6a51f54b7c94b625acb1d0d07, ASSIGN}] 2023-07-16 06:11:01,323 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c99c0fe6a51f54b7c94b625acb1d0d07, ASSIGN 2023-07-16 06:11:01,326 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c99c0fe6a51f54b7c94b625acb1d0d07, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34953,1689487858121; forceNewPlan=false, retain=false 2023-07-16 06:11:01,478 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 06:11:01,480 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c99c0fe6a51f54b7c94b625acb1d0d07, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:01,480 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689487861479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487861479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487861479"}]},"ts":"1689487861479"} 2023-07-16 06:11:01,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c99c0fe6a51f54b7c94b625acb1d0d07, server=jenkins-hbase4.apache.org,34953,1689487858121}] 2023-07-16 06:11:01,639 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:01,639 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:11:01,643 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:11:01,650 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:11:01,650 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c99c0fe6a51f54b7c94b625acb1d0d07, NAME => 'hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07.', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:11:01,650 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. service=AccessControlService 2023-07-16 06:11:01,651 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:01,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:01,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,655 INFO [StoreOpener-c99c0fe6a51f54b7c94b625acb1d0d07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,657 DEBUG [StoreOpener-c99c0fe6a51f54b7c94b625acb1d0d07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07/info 2023-07-16 06:11:01,657 DEBUG [StoreOpener-c99c0fe6a51f54b7c94b625acb1d0d07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07/info 2023-07-16 06:11:01,658 INFO [StoreOpener-c99c0fe6a51f54b7c94b625acb1d0d07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c99c0fe6a51f54b7c94b625acb1d0d07 columnFamilyName info 2023-07-16 06:11:01,659 INFO [StoreOpener-c99c0fe6a51f54b7c94b625acb1d0d07-1] regionserver.HStore(310): Store=c99c0fe6a51f54b7c94b625acb1d0d07/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:01,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:11:01,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:01,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c99c0fe6a51f54b7c94b625acb1d0d07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72027478, jitterRate=0.0732930600643158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:01,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c99c0fe6a51f54b7c94b625acb1d0d07: 2023-07-16 06:11:01,675 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07., pid=6, masterSystemTime=1689487861639 2023-07-16 06:11:01,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:11:01,681 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:11:01,682 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c99c0fe6a51f54b7c94b625acb1d0d07, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:01,683 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689487861682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487861682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487861682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487861682"}]},"ts":"1689487861682"} 2023-07-16 06:11:01,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-16 06:11:01,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c99c0fe6a51f54b7c94b625acb1d0d07, server=jenkins-hbase4.apache.org,34953,1689487858121 in 202 msec 2023-07-16 06:11:01,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-16 06:11:01,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c99c0fe6a51f54b7c94b625acb1d0d07, ASSIGN in 372 msec 2023-07-16 06:11:01,696 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:01,696 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487861696"}]},"ts":"1689487861696"} 2023-07-16 06:11:01,698 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-16 06:11:01,701 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:01,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 624 msec 2023-07-16 06:11:01,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-16 06:11:01,796 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-16 06:11:01,796 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:11:01,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:01,828 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:01,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-16 06:11:01,871 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 06:11:01,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 43 msec 2023-07-16 06:11:01,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-16 06:11:01,895 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 06:11:01,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-16 06:11:01,910 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 06:11:01,913 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-16 06:11:01,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.632sec 2023-07-16 06:11:01,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-16 06:11:01,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-16 06:11:01,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-16 06:11:01,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46097,1689487856540-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-16 06:11:01,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46097,1689487856540-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-16 06:11:01,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 06:11:01,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-16 06:11:01,951 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:01,953 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:01,956 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:01,957 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134 empty. 2023-07-16 06:11:01,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-16 06:11:01,959 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:01,959 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-16 06:11:02,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 06:11:02,011 DEBUG [Listener at localhost/44595] zookeeper.ReadOnlyZKClient(139): Connect 0x29a226bb to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:02,021 DEBUG [Listener at localhost/44595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dd3367c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:02,051 DEBUG [hconnection-0x451385ca-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:02,052 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:02,058 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6a71831d1301b145f7828dd65b2ab134, NAME => 'hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:11:02,083 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:02,088 WARN [DataStreamer for file /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/.regioninfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-16 06:11:02,089 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:11:02,089 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-16 06:11:02,089 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/test.cache.data in system properties and HBase conf 2023-07-16 06:11:02,089 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:02,089 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 06:11:02,089 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 6a71831d1301b145f7828dd65b2ab134, disabling compactions & flushes 2023-07-16 06:11:02,089 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop.log.dir in system properties and HBase conf 2023-07-16 06:11:02,089 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:11:02,090 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 06:11:02,090 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:11:02,090 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. after waiting 0 ms 2023-07-16 06:11:02,090 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 06:11:02,090 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:11:02,090 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 06:11:02,090 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:11:02,090 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 6a71831d1301b145f7828dd65b2ab134: 2023-07-16 06:11:02,091 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 06:11:02,091 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 06:11:02,091 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 06:11:02,091 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 06:11:02,091 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 06:11:02,091 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 06:11:02,091 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 06:11:02,091 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 06:11:02,092 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 06:11:02,092 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/nfs.dump.dir in system properties and HBase conf 2023-07-16 06:11:02,092 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir in system properties and HBase conf 2023-07-16 06:11:02,092 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 06:11:02,092 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 06:11:02,092 INFO [Listener at localhost/44595] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-16 06:11:02,095 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:02,097 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689487862096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487862096"}]},"ts":"1689487862096"} 2023-07-16 06:11:02,100 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 06:11:02,101 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:02,102 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487862101"}]},"ts":"1689487862101"} 2023-07-16 06:11:02,105 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-16 06:11:02,110 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:02,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 06:11:02,112 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:02,112 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:02,112 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:02,112 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:02,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6a71831d1301b145f7828dd65b2ab134, ASSIGN}] 2023-07-16 06:11:02,115 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6a71831d1301b145f7828dd65b2ab134, ASSIGN 2023-07-16 06:11:02,117 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=6a71831d1301b145f7828dd65b2ab134, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:11:02,267 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 06:11:02,269 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6a71831d1301b145f7828dd65b2ab134, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:02,269 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689487862269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487862269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487862269"}]},"ts":"1689487862269"} 2023-07-16 06:11:02,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6a71831d1301b145f7828dd65b2ab134, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:11:02,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 06:11:02,470 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:11:02,471 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a71831d1301b145f7828dd65b2ab134, NAME => 'hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134.', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:11:02,471 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. service=AccessControlService 2023-07-16 06:11:02,472 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:02,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:02,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:02,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:02,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:02,477 INFO [StoreOpener-6a71831d1301b145f7828dd65b2ab134-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:02,481 DEBUG [StoreOpener-6a71831d1301b145f7828dd65b2ab134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/l 2023-07-16 06:11:02,481 DEBUG [StoreOpener-6a71831d1301b145f7828dd65b2ab134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/l 2023-07-16 06:11:02,482 INFO [StoreOpener-6a71831d1301b145f7828dd65b2ab134-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a71831d1301b145f7828dd65b2ab134 columnFamilyName l 2023-07-16 06:11:02,483 INFO [StoreOpener-6a71831d1301b145f7828dd65b2ab134-1] regionserver.HStore(310): Store=6a71831d1301b145f7828dd65b2ab134/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:02,486 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:02,488 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:02,495 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:11:02,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:02,503 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6a71831d1301b145f7828dd65b2ab134; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67620488, jitterRate=0.007623791694641113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:02,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6a71831d1301b145f7828dd65b2ab134: 2023-07-16 06:11:02,507 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134., pid=11, masterSystemTime=1689487862439 2023-07-16 06:11:02,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:11:02,512 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:11:02,513 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6a71831d1301b145f7828dd65b2ab134, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:02,514 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689487862513"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487862513"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487862513"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487862513"}]},"ts":"1689487862513"} 2023-07-16 06:11:02,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-16 06:11:02,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6a71831d1301b145f7828dd65b2ab134, server=jenkins-hbase4.apache.org,41391,1689487858033 in 244 msec 2023-07-16 06:11:02,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-16 06:11:02,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=6a71831d1301b145f7828dd65b2ab134, ASSIGN in 410 msec 2023-07-16 06:11:02,529 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:02,529 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487862529"}]},"ts":"1689487862529"} 2023-07-16 06:11:02,532 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-16 06:11:02,536 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:02,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 589 msec 2023-07-16 06:11:02,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 06:11:02,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-16 06:11:02,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-16 06:11:03,409 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:11:03,734 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:11:03,741 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34743_jobhistory____.dzf44i/webapp 2023-07-16 06:11:03,919 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-16 06:11:03,919 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-16 06:11:03,919 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 06:11:03,923 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 06:11:04,005 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:04,285 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:04,684 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-16 06:11:04,721 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34743 2023-07-16 06:11:04,903 WARN [Listener at jenkins-hbase4.apache.org/45831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:11:05,318 WARN [Listener at jenkins-hbase4.apache.org/45831] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 06:11:05,319 INFO [Listener at jenkins-hbase4.apache.org/45831] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:11:05,346 INFO [Listener at jenkins-hbase4.apache.org/45831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42129_cluster____husbje/webapp 2023-07-16 06:11:05,436 INFO [Listener at jenkins-hbase4.apache.org/45831] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 06:11:05,437 INFO [Listener at jenkins-hbase4.apache.org/45831] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-16 06:11:05,437 INFO [Listener at jenkins-hbase4.apache.org/45831] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 06:11:05,438 INFO [Listener at jenkins-hbase4.apache.org/45831] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 06:11:05,454 INFO [Listener at jenkins-hbase4.apache.org/45831] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:05,816 INFO [Listener at jenkins-hbase4.apache.org/45831] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:06,100 INFO [Listener at jenkins-hbase4.apache.org/45831] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:06,129 INFO [Listener at jenkins-hbase4.apache.org/45831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42129 2023-07-16 06:11:06,481 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:11:06,680 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-16 06:11:06,682 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-16 06:11:06,683 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-16 06:11:06,711 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:06,712 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-16 06:11:06,713 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:06,713 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-16 06:11:06,713 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 06:11:06,713 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-16 06:11:06,713 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:06,713 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-16 06:11:06,714 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 06:11:06,714 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-16 06:11:06,921 WARN [Listener at jenkins-hbase4.apache.org/37201] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:11:06,949 WARN [Listener at jenkins-hbase4.apache.org/37201] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 06:11:06,949 INFO [Listener at jenkins-hbase4.apache.org/37201] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:11:06,955 INFO [Listener at jenkins-hbase4.apache.org/37201] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35553_node____ky4vu7/webapp 2023-07-16 06:11:07,023 INFO [Listener at jenkins-hbase4.apache.org/37201] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 06:11:07,023 INFO [Listener at jenkins-hbase4.apache.org/37201] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 06:11:07,023 INFO [Listener at jenkins-hbase4.apache.org/37201] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 06:11:07,023 INFO [Listener at jenkins-hbase4.apache.org/37201] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 06:11:07,032 INFO [Listener at jenkins-hbase4.apache.org/37201] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,063 INFO [Listener at jenkins-hbase4.apache.org/37201] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,136 INFO [Listener at jenkins-hbase4.apache.org/37201] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,148 INFO [Listener at jenkins-hbase4.apache.org/37201] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35553 2023-07-16 06:11:07,336 WARN [Listener at jenkins-hbase4.apache.org/41271] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 06:11:07,344 WARN [Listener at jenkins-hbase4.apache.org/41271] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 06:11:07,345 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 06:11:07,352 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38329_node____.bs5evh/webapp 2023-07-16 06:11:07,425 INFO [Listener at jenkins-hbase4.apache.org/41271] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 06:11:07,425 INFO [Listener at jenkins-hbase4.apache.org/41271] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 06:11:07,426 INFO [Listener at jenkins-hbase4.apache.org/41271] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 06:11:07,426 INFO [Listener at jenkins-hbase4.apache.org/41271] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 06:11:07,436 INFO [Listener at jenkins-hbase4.apache.org/41271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,456 INFO [Listener at jenkins-hbase4.apache.org/41271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,547 INFO [Listener at jenkins-hbase4.apache.org/41271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 06:11:07,553 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38329 2023-07-16 06:11:07,585 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-16 06:11:07,586 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:07,661 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=173, AvailableMemoryMB=4900 2023-07-16 06:11:07,661 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-16 06:11:07,679 DEBUG [Listener at jenkins-hbase4.apache.org/41271] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-16 06:11:07,691 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-16 06:11:07,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 06:11:07,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:07,708 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:07,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-16 06:11:07,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:07,712 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:07,718 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:07,719 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:07,719 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0 empty. 2023-07-16 06:11:07,726 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb empty. 2023-07-16 06:11:07,726 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:07,728 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:07,728 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 06:11:07,771 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:07,775 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 17b38fe790a62e8d3fc9733250dc9cc0, NAME => 'testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:11:07,775 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => fe4edf31cf4ec68d82d897640ada81fb, NAME => 'testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:11:07,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:07,818 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:07,816 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:07,820 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing fe4edf31cf4ec68d82d897640ada81fb, disabling compactions & flushes 2023-07-16 06:11:07,820 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 17b38fe790a62e8d3fc9733250dc9cc0, disabling compactions & flushes 2023-07-16 06:11:07,820 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:07,820 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:07,820 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:07,820 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:07,820 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. after waiting 0 ms 2023-07-16 06:11:07,820 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. after waiting 0 ms 2023-07-16 06:11:07,820 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:07,820 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:07,821 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:07,821 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:07,821 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for fe4edf31cf4ec68d82d897640ada81fb: 2023-07-16 06:11:07,821 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 17b38fe790a62e8d3fc9733250dc9cc0: 2023-07-16 06:11:07,825 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:07,826 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487867826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487867826"}]},"ts":"1689487867826"} 2023-07-16 06:11:07,827 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487867826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487867826"}]},"ts":"1689487867826"} 2023-07-16 06:11:07,878 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:11:07,880 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:07,880 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487867880"}]},"ts":"1689487867880"} 2023-07-16 06:11:07,883 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-16 06:11:07,888 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:07,890 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:07,890 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:07,890 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:07,890 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:07,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17b38fe790a62e8d3fc9733250dc9cc0, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fe4edf31cf4ec68d82d897640ada81fb, ASSIGN}] 2023-07-16 06:11:07,893 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fe4edf31cf4ec68d82d897640ada81fb, ASSIGN 2023-07-16 06:11:07,894 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17b38fe790a62e8d3fc9733250dc9cc0, ASSIGN 2023-07-16 06:11:07,895 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17b38fe790a62e8d3fc9733250dc9cc0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34953,1689487858121; forceNewPlan=false, retain=false 2023-07-16 06:11:07,895 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fe4edf31cf4ec68d82d897640ada81fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:11:08,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:08,045 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:11:08,047 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fe4edf31cf4ec68d82d897640ada81fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:08,047 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=17b38fe790a62e8d3fc9733250dc9cc0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:08,048 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487868047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487868047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487868047"}]},"ts":"1689487868047"} 2023-07-16 06:11:08,048 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487868047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487868047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487868047"}]},"ts":"1689487868047"} 2023-07-16 06:11:08,050 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure fe4edf31cf4ec68d82d897640ada81fb, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:11:08,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 17b38fe790a62e8d3fc9733250dc9cc0, server=jenkins-hbase4.apache.org,34953,1689487858121}] 2023-07-16 06:11:08,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17b38fe790a62e8d3fc9733250dc9cc0, NAME => 'testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:11:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. service=AccessControlService 2023-07-16 06:11:08,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:08,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:08,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:08,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:08,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:08,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:08,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe4edf31cf4ec68d82d897640ada81fb, NAME => 'testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:11:08,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. service=AccessControlService 2023-07-16 06:11:08,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:08,246 INFO [StoreOpener-17b38fe790a62e8d3fc9733250dc9cc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:08,246 INFO [StoreOpener-fe4edf31cf4ec68d82d897640ada81fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:08,250 DEBUG [StoreOpener-17b38fe790a62e8d3fc9733250dc9cc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf 2023-07-16 06:11:08,250 DEBUG [StoreOpener-17b38fe790a62e8d3fc9733250dc9cc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf 2023-07-16 06:11:08,254 DEBUG [StoreOpener-fe4edf31cf4ec68d82d897640ada81fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf 2023-07-16 06:11:08,254 DEBUG [StoreOpener-fe4edf31cf4ec68d82d897640ada81fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf 2023-07-16 06:11:08,255 INFO [StoreOpener-17b38fe790a62e8d3fc9733250dc9cc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17b38fe790a62e8d3fc9733250dc9cc0 columnFamilyName cf 2023-07-16 06:11:08,256 INFO [StoreOpener-fe4edf31cf4ec68d82d897640ada81fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe4edf31cf4ec68d82d897640ada81fb columnFamilyName cf 2023-07-16 06:11:08,265 INFO [StoreOpener-17b38fe790a62e8d3fc9733250dc9cc0-1] regionserver.HStore(310): Store=17b38fe790a62e8d3fc9733250dc9cc0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:08,267 INFO [StoreOpener-fe4edf31cf4ec68d82d897640ada81fb-1] regionserver.HStore(310): Store=fe4edf31cf4ec68d82d897640ada81fb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:08,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:08,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:08,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:08,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:08,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:08,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:08,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fe4edf31cf4ec68d82d897640ada81fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60130180, jitterRate=-0.10399049520492554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:08,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fe4edf31cf4ec68d82d897640ada81fb: 2023-07-16 06:11:08,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 17b38fe790a62e8d3fc9733250dc9cc0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62076993, jitterRate=-0.0749807208776474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:08,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 17b38fe790a62e8d3fc9733250dc9cc0: 2023-07-16 06:11:08,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0., pid=16, masterSystemTime=1689487868204 2023-07-16 06:11:08,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb., pid=15, masterSystemTime=1689487868203 2023-07-16 06:11:08,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:08,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:08,302 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=17b38fe790a62e8d3fc9733250dc9cc0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:08,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:08,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:08,302 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487868301"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487868301"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487868301"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487868301"}]},"ts":"1689487868301"} 2023-07-16 06:11:08,304 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fe4edf31cf4ec68d82d897640ada81fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:08,304 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487868304"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487868304"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487868304"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487868304"}]},"ts":"1689487868304"} 2023-07-16 06:11:08,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-16 06:11:08,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 17b38fe790a62e8d3fc9733250dc9cc0, server=jenkins-hbase4.apache.org,34953,1689487858121 in 253 msec 2023-07-16 06:11:08,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-16 06:11:08,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure fe4edf31cf4ec68d82d897640ada81fb, server=jenkins-hbase4.apache.org,41391,1689487858033 in 258 msec 2023-07-16 06:11:08,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17b38fe790a62e8d3fc9733250dc9cc0, ASSIGN in 420 msec 2023-07-16 06:11:08,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:08,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-16 06:11:08,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fe4edf31cf4ec68d82d897640ada81fb, ASSIGN in 430 msec 2023-07-16 06:11:08,331 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:08,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487868331"}]},"ts":"1689487868331"} 2023-07-16 06:11:08,333 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-16 06:11:08,336 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:08,342 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-16 06:11:08,362 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 06:11:08,395 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:08,395 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:08,395 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:08,395 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:08,395 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:11:08,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:08,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:08,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:08,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:08,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 704 msec 2023-07-16 06:11:08,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 06:11:08,826 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-16 06:11:08,832 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 06:11:08,833 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:08,836 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:08,869 DEBUG [hconnection-0x451385ca-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:08,873 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:08,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:08,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487868890 (current time:1689487868890). 2023-07-16 06:11:08,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:08,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x0d122c7a to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:08,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f648d2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:08,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:08,903 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:08,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d122c7a to 127.0.0.1:58206 2023-07-16 06:11:08,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:08,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x7350377c to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:08,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78cc6d42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:08,931 DEBUG [hconnection-0x5e7c5d92-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:08,935 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:08,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7350377c to 127.0.0.1:58206 2023-07-16 06:11:08,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:08,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 06:11:08,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:08,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:08,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:08,998 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:09,000 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689488469000 2023-07-16 06:11:09,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:09,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 06:11:09,003 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:09,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:09,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-16 06:11:09,007 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:09,008 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:09,008 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:09,008 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689488469008 2023-07-16 06:11:09,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,046 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-16 06:11:09,046 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,047 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 06:11:09,047 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 06:11:09,048 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,048 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,052 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,052 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,052 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,052 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,052 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,052 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,053 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,053 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:09,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 06:11:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 06:11:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 06:11:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,063 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,063 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,065 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,065 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,065 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,069 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,072 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,076 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,078 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,078 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,078 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,078 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,079 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,079 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,081 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,081 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,081 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,082 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,083 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,083 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 06:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16f6b3f0[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 06:11:09,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16f6b3f0[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:09,089 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 06:11:09,089 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,092 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,092 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,092 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,092 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,092 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,093 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,093 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:11:09,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,095 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,095 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,096 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,096 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:09,097 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:09,098 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:09,098 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:09,098 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. started... 2023-07-16 06:11:09,104 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17b38fe790a62e8d3fc9733250dc9cc0: 2023-07-16 06:11:09,106 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,108 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,115 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:09,117 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,115 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:09,117 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. started... 2023-07-16 06:11:09,117 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,117 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,119 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe4edf31cf4ec68d82d897640ada81fb: 2023-07-16 06:11:09,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,120 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,121 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:09,121 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:09,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:09,122 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:09,126 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:09,126 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:09,170 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. completed. 2023-07-16 06:11:09,170 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:11:09,171 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. completed. 2023-07-16 06:11:09,171 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:11:09,175 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,176 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,176 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,176 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,177 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,177 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,178 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,179 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 06:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34953,1689487858121': 2023-07-16 06:11:09,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 06:11:09,191 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-16 06:11:09,192 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:09,192 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:09,192 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,192 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:09,196 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,196 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,196 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,198 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,199 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,200 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,203 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,203 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,204 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,217 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,217 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,217 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,217 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,217 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,218 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,218 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,218 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,218 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-16 06:11:09,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:11:09,218 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,218 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:09,218 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,220 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,220 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,221 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,221 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,221 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,221 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 06:11:09,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:09,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:09,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,322 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:09,324 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:11:09,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 06:11:09,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,359 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:09,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689487869000Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689487869251 (+251 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689487869251Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689487869251Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689487869269 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689487869302 (+33 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689487869358 (+56 ms) 2023-07-16 06:11:09,360 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:09,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 358 msec 2023-07-16 06:11:09,624 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:09,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34953] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:09,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41391] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:09,650 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 06:11:09,650 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:09,650 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:09,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:09,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487869668 (current time:1689487869668). 2023-07-16 06:11:09,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:09,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x4452142a to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:09,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ab09345, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:09,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:09,679 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:09,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4452142a to 127.0.0.1:58206 2023-07-16 06:11:09,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:09,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x74f4ded9 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:09,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20d37729, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:09,694 DEBUG [hconnection-0x6eb7e2cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:09,698 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74f4ded9 to 127.0.0.1:58206 2023-07-16 06:11:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 06:11:09,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:09,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:09,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:09,711 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:09,713 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689488469713 2023-07-16 06:11:09,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 06:11:09,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 06:11:09,714 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:09,714 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:09,715 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 06:11:09,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:09,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-16 06:11:09,720 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:09,721 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689488469721 2023-07-16 06:11:09,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-16 06:11:09,746 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-16 06:11:09,747 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,748 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 06:11:09,748 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 06:11:09,748 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,748 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,749 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,750 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,750 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,749 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:09,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:09,750 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,750 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:09,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,751 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,751 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:09,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 06:11:09,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 06:11:09,752 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,752 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,752 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,752 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,753 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 06:11:09,755 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,755 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 06:11:09,755 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:09,754 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,756 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 06:11:09,756 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,755 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,756 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,756 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 06:11:09,756 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 06:11:09,759 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,759 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,759 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,761 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,761 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,761 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,761 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,761 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,761 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,761 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,761 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:09,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 06:11:09,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@164fda1b[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:09,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:09,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:09,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:09,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:09,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:09,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:09,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:09,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 06:11:09,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@164fda1b[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:09,766 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 06:11:09,766 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,773 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,773 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,773 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,774 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:09,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:11:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 06:11:09,774 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:09,774 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:09,774 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:09,775 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. started... 2023-07-16 06:11:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:09,775 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:09,775 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:09,774 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. started... 2023-07-16 06:11:09,774 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:09,775 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fe4edf31cf4ec68d82d897640ada81fb 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 06:11:09,775 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 17b38fe790a62e8d3fc9733250dc9cc0 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 06:11:09,777 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:09,777 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:09,777 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:09,814 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:09,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:09,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:09,816 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:09,938 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307167cbe7b49d88742f4871eff5455b353fa to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307167cbe7b49d88742f4871eff5455b353fa 2023-07-16 06:11:09,938 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307160f0501f5ed9b439eb2afbf5a05a8274a to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160f0501f5ed9b439eb2afbf5a05a8274a 2023-07-16 06:11:09,974 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/.tmp/cf/1165e8c8becc4aa4bd8cf72f3950c1cd 2023-07-16 06:11:09,975 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/.tmp/cf/7ccf7e26c8524d5b82836347f13cb94e 2023-07-16 06:11:09,989 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/.tmp/cf/1165e8c8becc4aa4bd8cf72f3950c1cd as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf/1165e8c8becc4aa4bd8cf72f3950c1cd 2023-07-16 06:11:09,989 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/.tmp/cf/7ccf7e26c8524d5b82836347f13cb94e as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf/7ccf7e26c8524d5b82836347f13cb94e 2023-07-16 06:11:09,999 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf/1165e8c8becc4aa4bd8cf72f3950c1cd, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 06:11:10,003 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf/7ccf7e26c8524d5b82836347f13cb94e, entries=47, sequenceid=6, filesize=12.8 K 2023-07-16 06:11:10,006 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 17b38fe790a62e8d3fc9733250dc9cc0 in 230ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:10,006 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 06:11:10,007 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for fe4edf31cf4ec68d82d897640ada81fb in 232ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:10,007 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17b38fe790a62e8d3fc9733250dc9cc0: 2023-07-16 06:11:10,008 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe4edf31cf4ec68d82d897640ada81fb: 2023-07-16 06:11:10,009 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:10,009 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:10,009 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:10,009 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:10,009 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf/1165e8c8becc4aa4bd8cf72f3950c1cd] hfiles 2023-07-16 06:11:10,009 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf/7ccf7e26c8524d5b82836347f13cb94e] hfiles 2023-07-16 06:11:10,009 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf/1165e8c8becc4aa4bd8cf72f3950c1cd for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:10,009 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf/7ccf7e26c8524d5b82836347f13cb94e for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:10,020 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:10,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:10,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:10,024 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:11:10,049 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. completed. 2023-07-16 06:11:10,049 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. completed. 2023-07-16 06:11:10,049 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:10,049 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:11:10,049 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 06:11:10,050 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:11:10,052 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,053 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:10,053 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:10,053 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:10,054 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 06:11:10,054 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:10,054 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,054 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 06:11:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:10,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34953,1689487858121': 2023-07-16 06:11:10,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 06:11:10,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:10,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:10,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:11:10,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 06:11:10,074 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-16 06:11:10,074 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:10,074 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:10,074 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-16 06:11:10,074 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:10,077 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:10,077 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:10,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:10,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:10,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,077 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:10,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:10,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:10,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:10,078 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:10,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:10,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:10,079 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:10,079 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:10,084 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 06:11:10,084 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,085 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,109 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:10,109 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:10,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:10,109 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:10,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:10,109 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:10,110 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,110 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:10,110 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,110 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:10,110 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:10,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:10,110 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,110 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,110 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:10,113 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,113 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:10,113 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:10,113 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,113 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:10,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:10,110 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-16 06:11:10,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-16 06:11:10,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 06:11:10,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:11:10,110 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:10,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:10,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307167cbe7b49d88742f4871eff5455b353fa, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160f0501f5ed9b439eb2afbf5a05a8274a] mob files 2023-07-16 06:11:10,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307167cbe7b49d88742f4871eff5455b353fa 2023-07-16 06:11:10,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160f0501f5ed9b439eb2afbf5a05a8274a 2023-07-16 06:11:10,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-16 06:11:10,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,215 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 06:11:10,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,216 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 06:11:10,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689487869713Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689487870140 (+427 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689487870140Loading Region manifests for snaptb0-testExportWithTargetName at 1689487870140Writing data manifest for snaptb0-testExportWithTargetName at 1689487870148 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689487870163 (+15 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689487870215 (+52 ms) 2023-07-16 06:11:10,218 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 06:11:10,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 504 msec 2023-07-16 06:11:10,324 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:10,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 06:11:10,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:10,328 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328 2023-07-16 06:11:10,329 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37171, tgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328, rawTgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328, srcFsUri=hdfs://localhost:37171, srcDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:10,380 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:10,381 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-286185813_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 06:11:10,381 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2, snapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-16 06:11:10,411 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 06:11:10,519 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,520 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,521 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,521 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,522 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,522 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,523 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,634 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop-3251534524748071202.jar 2023-07-16 06:11:10,635 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,636 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,637 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,637 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,638 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,639 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:10,640 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:11:10,640 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:11:10,641 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:11:10,642 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:11:10,642 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:11:10,643 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:11:10,644 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:11:10,645 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:11:10,645 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:11:10,646 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:11:10,651 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:10,651 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:10,652 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:10,652 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:10,653 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:10,653 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:10,654 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:12,107 WARN [Listener at jenkins-hbase4.apache.org/41271] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:11:12,113 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-16 06:11:12,124 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-16 06:11:12,692 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:12,694 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:13,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:13,731 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:11:18,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:20,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:23,995 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:25,105 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:11:25,109 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:11:25,119 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-16 06:11:25,119 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:11:25,120 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:11:25,120 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 06:11:25,121 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-16 06:11:25,121 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-16 06:11:25,121 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328/.hbase-snapshot/testExportWithTargetName 2023-07-16 06:11:25,122 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-16 06:11:25,122 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487870328/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-16 06:11:25,135 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-16 06:11:25,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-16 06:11:25,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,156 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487885156"}]},"ts":"1689487885156"} 2023-07-16 06:11:25,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 06:11:25,158 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-16 06:11:25,243 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-16 06:11:25,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17b38fe790a62e8d3fc9733250dc9cc0, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fe4edf31cf4ec68d82d897640ada81fb, UNASSIGN}] 2023-07-16 06:11:25,248 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17b38fe790a62e8d3fc9733250dc9cc0, UNASSIGN 2023-07-16 06:11:25,248 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fe4edf31cf4ec68d82d897640ada81fb, UNASSIGN 2023-07-16 06:11:25,249 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fe4edf31cf4ec68d82d897640ada81fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:25,249 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=17b38fe790a62e8d3fc9733250dc9cc0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:25,249 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487885249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487885249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487885249"}]},"ts":"1689487885249"} 2023-07-16 06:11:25,250 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487885249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487885249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487885249"}]},"ts":"1689487885249"} 2023-07-16 06:11:25,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure fe4edf31cf4ec68d82d897640ada81fb, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:11:25,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 17b38fe790a62e8d3fc9733250dc9cc0, server=jenkins-hbase4.apache.org,34953,1689487858121}] 2023-07-16 06:11:25,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 06:11:25,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:25,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 17b38fe790a62e8d3fc9733250dc9cc0, disabling compactions & flushes 2023-07-16 06:11:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fe4edf31cf4ec68d82d897640ada81fb, disabling compactions & flushes 2023-07-16 06:11:25,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:25,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. after waiting 0 ms 2023-07-16 06:11:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. after waiting 0 ms 2023-07-16 06:11:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:25,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:11:25,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:25,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0. 2023-07-16 06:11:25,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 17b38fe790a62e8d3fc9733250dc9cc0: 2023-07-16 06:11:25,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:25,448 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=17b38fe790a62e8d3fc9733250dc9cc0, regionState=CLOSED 2023-07-16 06:11:25,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:11:25,448 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487885448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487885448"}]},"ts":"1689487885448"} 2023-07-16 06:11:25,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:25,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb. 2023-07-16 06:11:25,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fe4edf31cf4ec68d82d897640ada81fb: 2023-07-16 06:11:25,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:25,454 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fe4edf31cf4ec68d82d897640ada81fb, regionState=CLOSED 2023-07-16 06:11:25,454 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689487885454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487885454"}]},"ts":"1689487885454"} 2023-07-16 06:11:25,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-16 06:11:25,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 17b38fe790a62e8d3fc9733250dc9cc0, server=jenkins-hbase4.apache.org,34953,1689487858121 in 200 msec 2023-07-16 06:11:25,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17b38fe790a62e8d3fc9733250dc9cc0, UNASSIGN in 211 msec 2023-07-16 06:11:25,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 06:11:25,465 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-16 06:11:25,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure fe4edf31cf4ec68d82d897640ada81fb, server=jenkins-hbase4.apache.org,41391,1689487858033 in 208 msec 2023-07-16 06:11:25,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-16 06:11:25,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fe4edf31cf4ec68d82d897640ada81fb, UNASSIGN in 220 msec 2023-07-16 06:11:25,470 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487885470"}]},"ts":"1689487885470"} 2023-07-16 06:11:25,472 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-16 06:11:25,566 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-16 06:11:25,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 423 msec 2023-07-16 06:11:25,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 06:11:25,762 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-16 06:11:25,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-16 06:11:25,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,777 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-16 06:11:25,779 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,782 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-16 06:11:25,785 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:25,785 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:25,789 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/recovered.edits] 2023-07-16 06:11:25,789 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/recovered.edits] 2023-07-16 06:11:25,797 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf/7ccf7e26c8524d5b82836347f13cb94e to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/cf/7ccf7e26c8524d5b82836347f13cb94e 2023-07-16 06:11:25,797 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf/1165e8c8becc4aa4bd8cf72f3950c1cd to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/cf/1165e8c8becc4aa4bd8cf72f3950c1cd 2023-07-16 06:11:25,803 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0/recovered.edits/9.seqid 2023-07-16 06:11:25,803 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb/recovered.edits/9.seqid 2023-07-16 06:11:25,804 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/17b38fe790a62e8d3fc9733250dc9cc0 2023-07-16 06:11:25,804 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportWithTargetName/fe4edf31cf4ec68d82d897640ada81fb 2023-07-16 06:11:25,805 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 06:11:25,805 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-16 06:11:25,806 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-16 06:11:25,820 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307167cbe7b49d88742f4871eff5455b353fa to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307167cbe7b49d88742f4871eff5455b353fa 2023-07-16 06:11:25,822 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160f0501f5ed9b439eb2afbf5a05a8274a to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160f0501f5ed9b439eb2afbf5a05a8274a 2023-07-16 06:11:25,827 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-16 06:11:25,832 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,863 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-16 06:11:25,898 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,899 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,898 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,898 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 06:11:25,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-16 06:11:25,903 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:25,904 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-16 06:11:25,904 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487885904"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:25,904 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487885904"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:25,907 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:11:25,907 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 17b38fe790a62e8d3fc9733250dc9cc0, NAME => 'testtb-testExportWithTargetName,,1689487867701.17b38fe790a62e8d3fc9733250dc9cc0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fe4edf31cf4ec68d82d897640ada81fb, NAME => 'testtb-testExportWithTargetName,1,1689487867701.fe4edf31cf4ec68d82d897640ada81fb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:11:25,907 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-16 06:11:25,907 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487885907"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:25,910 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-16 06:11:25,974 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:25,974 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:25,974 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:25,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 06:11:25,974 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:25,974 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:11:25,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 06:11:25,975 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:11:25,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 06:11:25,975 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:11:25,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 06:11:25,976 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:11:25,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 06:11:26,029 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 06:11:26,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 260 msec 2023-07-16 06:11:26,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 06:11:26,082 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-16 06:11:26,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-16 06:11:26,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-16 06:11:26,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-16 06:11:26,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-16 06:11:26,141 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 707) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_97434495_1 at /127.0.0.1:44104 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1314 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:44136 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:56576 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:34164 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:41657 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:34765 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=401 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=3277 (was 4900) 2023-07-16 06:11:26,141 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-16 06:11:26,162 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=401, ProcessCount=180, AvailableMemoryMB=3276 2023-07-16 06:11:26,162 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-16 06:11:26,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 06:11:26,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:26,169 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:26,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-16 06:11:26,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:26,172 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:26,175 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,175 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,176 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550 empty. 2023-07-16 06:11:26,176 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3 empty. 2023-07-16 06:11:26,176 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,176 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,176 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 06:11:26,191 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:26,192 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 550043d6107a25e958b205ac56575550, NAME => 'testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:11:26,193 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9604e0269cabc08b4602589bc21056c3, NAME => 'testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:11:26,216 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:26,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:26,224 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 550043d6107a25e958b205ac56575550, disabling compactions & flushes 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9604e0269cabc08b4602589bc21056c3, disabling compactions & flushes 2023-07-16 06:11:26,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:26,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. after waiting 0 ms 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. after waiting 0 ms 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:26,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:26,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9604e0269cabc08b4602589bc21056c3: 2023-07-16 06:11:26,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 550043d6107a25e958b205ac56575550: 2023-07-16 06:11:26,229 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:26,231 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886230"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487886230"}]},"ts":"1689487886230"} 2023-07-16 06:11:26,231 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886230"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487886230"}]},"ts":"1689487886230"} 2023-07-16 06:11:26,233 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:11:26,235 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:26,235 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487886235"}]},"ts":"1689487886235"} 2023-07-16 06:11:26,237 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 06:11:26,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:26,335 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:26,336 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:26,337 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:26,337 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:26,337 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:26,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=550043d6107a25e958b205ac56575550, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9604e0269cabc08b4602589bc21056c3, ASSIGN}] 2023-07-16 06:11:26,340 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=550043d6107a25e958b205ac56575550, ASSIGN 2023-07-16 06:11:26,340 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9604e0269cabc08b4602589bc21056c3, ASSIGN 2023-07-16 06:11:26,341 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9604e0269cabc08b4602589bc21056c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35311,1689487858185; forceNewPlan=false, retain=false 2023-07-16 06:11:26,341 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=550043d6107a25e958b205ac56575550, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:11:26,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:26,491 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:11:26,494 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=550043d6107a25e958b205ac56575550, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:26,494 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9604e0269cabc08b4602589bc21056c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:26,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886494"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487886494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487886494"}]},"ts":"1689487886494"} 2023-07-16 06:11:26,494 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886494"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487886494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487886494"}]},"ts":"1689487886494"} 2023-07-16 06:11:26,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 9604e0269cabc08b4602589bc21056c3, server=jenkins-hbase4.apache.org,35311,1689487858185}] 2023-07-16 06:11:26,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 550043d6107a25e958b205ac56575550, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:11:26,651 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:26,651 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:11:26,655 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:11:26,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:26,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 550043d6107a25e958b205ac56575550, NAME => 'testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:11:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. service=AccessControlService 2023-07-16 06:11:26,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,662 INFO [StoreOpener-550043d6107a25e958b205ac56575550-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:26,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9604e0269cabc08b4602589bc21056c3, NAME => 'testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:11:26,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. service=AccessControlService 2023-07-16 06:11:26,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:26,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:26,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,664 DEBUG [StoreOpener-550043d6107a25e958b205ac56575550-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf 2023-07-16 06:11:26,664 DEBUG [StoreOpener-550043d6107a25e958b205ac56575550-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf 2023-07-16 06:11:26,665 INFO [StoreOpener-550043d6107a25e958b205ac56575550-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 550043d6107a25e958b205ac56575550 columnFamilyName cf 2023-07-16 06:11:26,665 INFO [StoreOpener-9604e0269cabc08b4602589bc21056c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,667 INFO [StoreOpener-550043d6107a25e958b205ac56575550-1] regionserver.HStore(310): Store=550043d6107a25e958b205ac56575550/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:26,668 DEBUG [StoreOpener-9604e0269cabc08b4602589bc21056c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf 2023-07-16 06:11:26,668 DEBUG [StoreOpener-9604e0269cabc08b4602589bc21056c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf 2023-07-16 06:11:26,669 INFO [StoreOpener-9604e0269cabc08b4602589bc21056c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9604e0269cabc08b4602589bc21056c3 columnFamilyName cf 2023-07-16 06:11:26,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,670 INFO [StoreOpener-9604e0269cabc08b4602589bc21056c3-1] regionserver.HStore(310): Store=9604e0269cabc08b4602589bc21056c3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:26,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 550043d6107a25e958b205ac56575550 2023-07-16 06:11:26,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:26,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:26,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 550043d6107a25e958b205ac56575550; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71103805, jitterRate=0.05952925980091095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 550043d6107a25e958b205ac56575550: 2023-07-16 06:11:26,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550., pid=31, masterSystemTime=1689487886651 2023-07-16 06:11:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:26,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9604e0269cabc08b4602589bc21056c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72426753, jitterRate=0.07924272119998932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:26,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9604e0269cabc08b4602589bc21056c3: 2023-07-16 06:11:26,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:26,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:26,682 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=550043d6107a25e958b205ac56575550, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:26,683 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487886682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487886682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487886682"}]},"ts":"1689487886682"} 2023-07-16 06:11:26,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3., pid=30, masterSystemTime=1689487886651 2023-07-16 06:11:26,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:26,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:26,696 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9604e0269cabc08b4602589bc21056c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:26,697 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487886694"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487886694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487886694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487886694"}]},"ts":"1689487886694"} 2023-07-16 06:11:26,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-16 06:11:26,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 550043d6107a25e958b205ac56575550, server=jenkins-hbase4.apache.org,41391,1689487858033 in 192 msec 2023-07-16 06:11:26,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=550043d6107a25e958b205ac56575550, ASSIGN in 361 msec 2023-07-16 06:11:26,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-16 06:11:26,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 9604e0269cabc08b4602589bc21056c3, server=jenkins-hbase4.apache.org,35311,1689487858185 in 203 msec 2023-07-16 06:11:26,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-16 06:11:26,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9604e0269cabc08b4602589bc21056c3, ASSIGN in 371 msec 2023-07-16 06:11:26,712 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:26,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487886712"}]},"ts":"1689487886712"} 2023-07-16 06:11:26,714 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 06:11:26,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:26,760 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-16 06:11:26,762 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:11:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:26,804 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:26,804 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:26,804 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:26,804 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:26,844 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:26,844 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:26,844 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:26,845 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:26,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 679 msec 2023-07-16 06:11:27,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 06:11:27,277 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-16 06:11:27,281 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 06:11:27,281 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:27,285 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:27,303 DEBUG [hconnection-0x451385ca-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:27,308 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:27,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487887313 (current time:1689487887313). 2023-07-16 06:11:27,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:27,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x0e545932 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:27,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d53a1d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:27,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:27,404 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:27,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e545932 to 127.0.0.1:58206 2023-07-16 06:11:27,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:27,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x1717ac1e to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:27,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ba6fa07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:27,487 DEBUG [hconnection-0x3bfba1a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:27,488 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:27,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1717ac1e to 127.0.0.1:58206 2023-07-16 06:11:27,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:27,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:11:27,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:27,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,506 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,507 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689488487507 2023-07-16 06:11:27,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 06:11:27,508 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:27,509 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:27,511 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-16 06:11:27,514 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,516 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689488487516 2023-07-16 06:11:27,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,531 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-16 06:11:27,531 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,532 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 06:11:27,532 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 06:11:27,533 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,533 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,552 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,552 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,552 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,552 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,553 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,553 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,554 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,554 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 06:11:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,556 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,556 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,556 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,556 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,557 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,558 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,556 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,558 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,558 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,558 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,558 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,558 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,559 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,559 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,559 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,565 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,565 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,566 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,566 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 06:11:27,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d67f5af[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 06:11:27,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d67f5af[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:27,572 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 06:11:27,572 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,573 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:11:27,574 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:27,574 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:27,575 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. started... 2023-07-16 06:11:27,574 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:27,575 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,575 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:27,576 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9604e0269cabc08b4602589bc21056c3: 2023-07-16 06:11:27,575 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. started... 2023-07-16 06:11:27,577 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 550043d6107a25e958b205ac56575550: 2023-07-16 06:11:27,577 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,577 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:27,577 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,577 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:27,577 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:27,577 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:27,577 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,577 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,577 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,603 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. completed. 2023-07-16 06:11:27,603 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:11:27,606 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. completed. 2023-07-16 06:11:27,606 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:11:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,606 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,607 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,607 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,609 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:27,610 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,610 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,610 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,610 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:27,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:27,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,612 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35311,1689487858185': 2023-07-16 06:11:27,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 06:11:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:11:27,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 06:11:27,620 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-16 06:11:27,620 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:27,620 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:27,620 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,620 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:27,621 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,622 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,622 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,622 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,622 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,623 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,624 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,631 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,631 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,632 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,635 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,635 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,636 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,635 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,635 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,636 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,636 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:27,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-16 06:11:27,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:27,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:27,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:11:27,638 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,639 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 06:11:27,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 06:11:27,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,757 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:27,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689487887507Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689487887658 (+151 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689487887658Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689487887658Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689487887670 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689487887699 (+29 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689487887757 (+58 ms) 2023-07-16 06:11:27,760 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 250 msec 2023-07-16 06:11:27,812 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:27,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:27,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:27,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41391] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:27,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35311] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:27,825 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 06:11:27,825 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:27,825 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:27,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487887838 (current time:1689487887838). 2023-07-16 06:11:27,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:27,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x68ff67e1 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:27,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4055f1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:27,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:27,851 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:27,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68ff67e1 to 127.0.0.1:58206 2023-07-16 06:11:27,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:27,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x5d029873 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:27,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60024712, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:27,864 DEBUG [hconnection-0x5239f9ea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:27,867 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:27,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d029873 to 127.0.0.1:58206 2023-07-16 06:11:27,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:27,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:11:27,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:27,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,878 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,879 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689488487879 2023-07-16 06:11:27,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:11:27,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 06:11:27,880 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:27,880 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:27,882 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:11:27,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 06:11:27,884 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:27,885 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689488487885 2023-07-16 06:11:27,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-16 06:11:27,895 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-16 06:11:27,895 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,896 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 06:11:27,896 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 06:11:27,897 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,897 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,898 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,898 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,898 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:27,898 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,899 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,899 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,899 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,899 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 06:11:27,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 06:11:27,900 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,900 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,900 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,902 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,902 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,902 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 06:11:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 06:11:27,902 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 06:11:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 06:11:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 06:11:27,905 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,906 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,906 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 06:11:27,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e2da0c0[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:27,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 06:11:27,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e2da0c0[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:27,911 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 06:11:27,911 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,913 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,913 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,913 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,914 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:11:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:11:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:27,914 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:27,914 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:27,914 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. started... 2023-07-16 06:11:27,914 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:27,914 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:27,914 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. started... 2023-07-16 06:11:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:27,914 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9604e0269cabc08b4602589bc21056c3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 06:11:27,914 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 550043d6107a25e958b205ac56575550 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 06:11:27,915 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:27,915 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:27,915 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:27,948 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307164c3a1b8adf4c4d919766b4b365914479 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307164c3a1b8adf4c4d919766b4b365914479 2023-07-16 06:11:27,957 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071631f91cc75485474c93ed1f399a8ac241 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071631f91cc75485474c93ed1f399a8ac241 2023-07-16 06:11:27,981 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:27,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:27,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:27,983 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:27,990 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/.tmp/cf/04a5b459ea2546f4a0b6ae0b9fa98362 2023-07-16 06:11:27,997 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/.tmp/cf/04a5b459ea2546f4a0b6ae0b9fa98362 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf/04a5b459ea2546f4a0b6ae0b9fa98362 2023-07-16 06:11:28,005 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf/04a5b459ea2546f4a0b6ae0b9fa98362, entries=47, sequenceid=6, filesize=12.8 K 2023-07-16 06:11:28,007 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 9604e0269cabc08b4602589bc21056c3 in 93ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:28,007 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 06:11:28,008 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9604e0269cabc08b4602589bc21056c3: 2023-07-16 06:11:28,008 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:28,008 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:28,008 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf/04a5b459ea2546f4a0b6ae0b9fa98362] hfiles 2023-07-16 06:11:28,008 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf/04a5b459ea2546f4a0b6ae0b9fa98362 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:28,032 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. completed. 2023-07-16 06:11:28,032 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:28,032 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:28,032 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:28,032 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,032 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:28,032 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:11:28,036 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:28,036 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,037 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:28,037 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:28,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:28,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:28,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:28,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:28,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:28,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:28,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35311,1689487858185': 2023-07-16 06:11:28,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 06:11:28,183 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:28,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:28,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:28,185 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:11:28,372 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/.tmp/cf/83dbba6b8ad44c0aa6fd428384cfce65 2023-07-16 06:11:28,381 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/.tmp/cf/83dbba6b8ad44c0aa6fd428384cfce65 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf/83dbba6b8ad44c0aa6fd428384cfce65 2023-07-16 06:11:28,388 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf/83dbba6b8ad44c0aa6fd428384cfce65, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 06:11:28,389 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 550043d6107a25e958b205ac56575550 in 475ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:28,391 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 550043d6107a25e958b205ac56575550: 2023-07-16 06:11:28,391 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:28,392 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:28,392 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf/83dbba6b8ad44c0aa6fd428384cfce65] hfiles 2023-07-16 06:11:28,392 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf/83dbba6b8ad44c0aa6fd428384cfce65 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:28,403 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. completed. 2023-07-16 06:11:28,403 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 06:11:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:11:28,405 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 06:11:28,405 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,405 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:28,405 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 06:11:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:28,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:28,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:28,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:28,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:11:28,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 06:11:28,412 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-16 06:11:28,412 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:28,412 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:28,412 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-16 06:11:28,412 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:28,414 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,414 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,414 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,414 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:28,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,414 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:28,414 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:28,414 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:28,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:28,419 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:28,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:28,419 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,420 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:28,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 06:11:28,428 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,429 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,429 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,434 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,434 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,434 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:28,434 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-16 06:11:28,434 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:28,434 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:28,436 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:28,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:28,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:28,436 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:28,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-16 06:11:28,436 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:28,436 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:28,436 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 06:11:28,436 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:28,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:11:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:28,436 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:28,437 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,437 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:28,437 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:28,437 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,437 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071631f91cc75485474c93ed1f399a8ac241, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307164c3a1b8adf4c4d919766b4b365914479] mob files 2023-07-16 06:11:28,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071631f91cc75485474c93ed1f399a8ac241 2023-07-16 06:11:28,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307164c3a1b8adf4c4d919766b4b365914479 2023-07-16 06:11:28,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:28,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:28,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:28,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-16 06:11:28,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,485 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:28,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:28,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:28,487 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 06:11:28,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 06:11:28,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,540 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:28,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689487887879Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689487888448 (+569 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689487888448Loading Region manifests for snaptb0-testExportFileSystemState at 1689487888449 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689487888453 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689487888502 (+49 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689487888539 (+37 ms) 2023-07-16 06:11:28,543 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 06:11:28,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 663 msec 2023-07-16 06:11:28,987 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:28,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:11:28,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:28,989 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989 2023-07-16 06:11:28,989 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37171, tgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989, rawTgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989, srcFsUri=hdfs://localhost:37171, srcDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:29,013 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:29,013 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_463926547_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:29,013 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2, snapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-16 06:11:29,028 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 06:11:29,055 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,056 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,056 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,057 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,057 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,057 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,058 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,129 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop-4511968787204532754.jar 2023-07-16 06:11:29,129 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,130 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,130 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,130 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,131 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,131 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:29,131 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:11:29,132 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:11:29,132 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:11:29,132 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:11:29,133 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:11:29,134 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:11:29,134 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:11:29,135 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:11:29,135 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:11:29,136 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:11:29,136 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:29,137 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:29,137 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:29,137 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:29,137 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:29,138 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:29,138 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:29,575 WARN [Listener at jenkins-hbase4.apache.org/41271] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:11:29,578 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-16 06:11:29,581 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-16 06:11:30,210 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:30,210 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:30,217 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0001_000001 (auth:SIMPLE) 2023-07-16 06:11:30,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:31,064 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:11:35,579 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:37,819 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:41,398 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:42,827 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:11:42,828 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:11:42,837 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-16 06:11:42,838 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:11:42,838 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:11:42,839 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 06:11:42,839 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 06:11:42,839 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 06:11:42,840 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 06:11:42,840 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 06:11:42,840 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487888989/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 06:11:42,850 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-16 06:11:42,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-16 06:11:42,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:42,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 06:11:42,857 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487902857"}]},"ts":"1689487902857"} 2023-07-16 06:11:42,859 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 06:11:42,861 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-16 06:11:42,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=550043d6107a25e958b205ac56575550, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9604e0269cabc08b4602589bc21056c3, UNASSIGN}] 2023-07-16 06:11:42,865 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=550043d6107a25e958b205ac56575550, UNASSIGN 2023-07-16 06:11:42,865 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9604e0269cabc08b4602589bc21056c3, UNASSIGN 2023-07-16 06:11:42,866 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=550043d6107a25e958b205ac56575550, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:42,866 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9604e0269cabc08b4602589bc21056c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:42,866 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487902866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487902866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487902866"}]},"ts":"1689487902866"} 2023-07-16 06:11:42,866 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487902866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487902866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487902866"}]},"ts":"1689487902866"} 2023-07-16 06:11:42,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 550043d6107a25e958b205ac56575550, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:11:42,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 9604e0269cabc08b4602589bc21056c3, server=jenkins-hbase4.apache.org,35311,1689487858185}] 2023-07-16 06:11:42,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 06:11:43,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 550043d6107a25e958b205ac56575550 2023-07-16 06:11:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 550043d6107a25e958b205ac56575550, disabling compactions & flushes 2023-07-16 06:11:43,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. after waiting 0 ms 2023-07-16 06:11:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:43,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:43,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9604e0269cabc08b4602589bc21056c3, disabling compactions & flushes 2023-07-16 06:11:43,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:43,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:43,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. after waiting 0 ms 2023-07-16 06:11:43,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:43,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:11:43,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:43,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550. 2023-07-16 06:11:43,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 550043d6107a25e958b205ac56575550: 2023-07-16 06:11:43,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:11:43,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 550043d6107a25e958b205ac56575550 2023-07-16 06:11:43,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:11:43,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3. 2023-07-16 06:11:43,053 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=550043d6107a25e958b205ac56575550, regionState=CLOSED 2023-07-16 06:11:43,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9604e0269cabc08b4602589bc21056c3: 2023-07-16 06:11:43,054 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487903053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487903053"}]},"ts":"1689487903053"} 2023-07-16 06:11:43,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:43,060 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9604e0269cabc08b4602589bc21056c3, regionState=CLOSED 2023-07-16 06:11:43,060 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689487903060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487903060"}]},"ts":"1689487903060"} 2023-07-16 06:11:43,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-16 06:11:43,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 550043d6107a25e958b205ac56575550, server=jenkins-hbase4.apache.org,41391,1689487858033 in 187 msec 2023-07-16 06:11:43,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=550043d6107a25e958b205ac56575550, UNASSIGN in 199 msec 2023-07-16 06:11:43,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-16 06:11:43,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 9604e0269cabc08b4602589bc21056c3, server=jenkins-hbase4.apache.org,35311,1689487858185 in 191 msec 2023-07-16 06:11:43,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-16 06:11:43,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9604e0269cabc08b4602589bc21056c3, UNASSIGN in 202 msec 2023-07-16 06:11:43,067 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487903067"}]},"ts":"1689487903067"} 2023-07-16 06:11:43,069 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 06:11:43,071 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-16 06:11:43,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 221 msec 2023-07-16 06:11:43,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 06:11:43,160 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-16 06:11:43,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-16 06:11:43,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:43,168 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:43,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-16 06:11:43,169 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:43,170 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-16 06:11:43,173 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:43,173 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:43,173 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:43,173 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:43,174 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 06:11:43,174 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 06:11:43,174 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 06:11:43,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 06:11:43,175 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550 2023-07-16 06:11:43,176 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:43,176 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:43,176 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:43,176 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:43,176 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:43,176 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 06:11:43,176 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:43,176 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:43,177 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:43,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 06:11:43,179 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/recovered.edits] 2023-07-16 06:11:43,179 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/recovered.edits] 2023-07-16 06:11:43,184 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf/04a5b459ea2546f4a0b6ae0b9fa98362 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/cf/04a5b459ea2546f4a0b6ae0b9fa98362 2023-07-16 06:11:43,184 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf/83dbba6b8ad44c0aa6fd428384cfce65 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/cf/83dbba6b8ad44c0aa6fd428384cfce65 2023-07-16 06:11:43,191 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550/recovered.edits/9.seqid 2023-07-16 06:11:43,191 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3/recovered.edits/9.seqid 2023-07-16 06:11:43,192 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/550043d6107a25e958b205ac56575550 2023-07-16 06:11:43,192 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemState/9604e0269cabc08b4602589bc21056c3 2023-07-16 06:11:43,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 06:11:43,193 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-16 06:11:43,194 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-16 06:11:43,199 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071631f91cc75485474c93ed1f399a8ac241 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071631f91cc75485474c93ed1f399a8ac241 2023-07-16 06:11:43,201 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307164c3a1b8adf4c4d919766b4b365914479 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307164c3a1b8adf4c4d919766b4b365914479 2023-07-16 06:11:43,202 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-16 06:11:43,207 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:43,210 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-16 06:11:43,212 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-16 06:11:43,214 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:43,214 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-16 06:11:43,214 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487903214"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:43,214 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487903214"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:43,217 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:11:43,217 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 550043d6107a25e958b205ac56575550, NAME => 'testtb-testExportFileSystemState,,1689487886164.550043d6107a25e958b205ac56575550.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9604e0269cabc08b4602589bc21056c3, NAME => 'testtb-testExportFileSystemState,1,1689487886164.9604e0269cabc08b4602589bc21056c3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:11:43,217 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-16 06:11:43,217 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487903217"}]},"ts":"9223372036854775807"} 2023-07-16 06:11:43,219 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-16 06:11:43,221 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 06:11:43,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 59 msec 2023-07-16 06:11:43,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 06:11:43,279 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-16 06:11:43,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-16 06:11:43,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-16 06:11:43,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-16 06:11:43,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-16 06:11:43,318 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=764 (was 751) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:34157 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1052126082_1 at /127.0.0.1:50290 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:50310 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2025 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:37252 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1052126082_1 at /127.0.0.1:56396 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:56410 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:37201 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=407 (was 401) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=2827 (was 3276) 2023-07-16 06:11:43,318 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 06:11:43,338 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=407, ProcessCount=180, AvailableMemoryMB=2827 2023-07-16 06:11:43,339 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 06:11:43,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 06:11:43,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:11:43,344 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:11:43,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-16 06:11:43,345 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:11:43,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 06:11:43,348 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,348 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,348 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5 empty. 2023-07-16 06:11:43,348 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239 empty. 2023-07-16 06:11:43,349 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,349 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,349 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 06:11:43,360 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-16 06:11:43,361 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ec0c5b097cecebaaef1c2fda1e810b5, NAME => 'testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:11:43,361 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => c1b864be0260b849d52ed83fd9548239, NAME => 'testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:11:43,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:43,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing c1b864be0260b849d52ed83fd9548239, disabling compactions & flushes 2023-07-16 06:11:43,389 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:43,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:43,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. after waiting 0 ms 2023-07-16 06:11:43,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:43,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:43,389 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:43,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 6ec0c5b097cecebaaef1c2fda1e810b5, disabling compactions & flushes 2023-07-16 06:11:43,389 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for c1b864be0260b849d52ed83fd9548239: 2023-07-16 06:11:43,389 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:43,390 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:43,390 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. after waiting 0 ms 2023-07-16 06:11:43,390 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:43,390 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:43,390 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 6ec0c5b097cecebaaef1c2fda1e810b5: 2023-07-16 06:11:43,392 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:11:43,393 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487903393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487903393"}]},"ts":"1689487903393"} 2023-07-16 06:11:43,393 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487903393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487903393"}]},"ts":"1689487903393"} 2023-07-16 06:11:43,396 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:11:43,397 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:11:43,397 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487903397"}]},"ts":"1689487903397"} 2023-07-16 06:11:43,399 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-16 06:11:43,402 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:11:43,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:11:43,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:11:43,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:11:43,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:11:43,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6ec0c5b097cecebaaef1c2fda1e810b5, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c1b864be0260b849d52ed83fd9548239, ASSIGN}] 2023-07-16 06:11:43,406 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c1b864be0260b849d52ed83fd9548239, ASSIGN 2023-07-16 06:11:43,406 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6ec0c5b097cecebaaef1c2fda1e810b5, ASSIGN 2023-07-16 06:11:43,407 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c1b864be0260b849d52ed83fd9548239, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35311,1689487858185; forceNewPlan=false, retain=false 2023-07-16 06:11:43,407 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6ec0c5b097cecebaaef1c2fda1e810b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:11:43,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 06:11:43,557 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:11:43,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c1b864be0260b849d52ed83fd9548239, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:43,560 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6ec0c5b097cecebaaef1c2fda1e810b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:43,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487903560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487903560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487903560"}]},"ts":"1689487903560"} 2023-07-16 06:11:43,560 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487903560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487903560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487903560"}]},"ts":"1689487903560"} 2023-07-16 06:11:43,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure c1b864be0260b849d52ed83fd9548239, server=jenkins-hbase4.apache.org,35311,1689487858185}] 2023-07-16 06:11:43,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 6ec0c5b097cecebaaef1c2fda1e810b5, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:11:43,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 06:11:43,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:43,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1b864be0260b849d52ed83fd9548239, NAME => 'testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:11:43,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. service=AccessControlService 2023-07-16 06:11:43,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:43,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:43,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:43,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ec0c5b097cecebaaef1c2fda1e810b5, NAME => 'testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:11:43,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. service=AccessControlService 2023-07-16 06:11:43,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:11:43,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:11:43,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,721 INFO [StoreOpener-c1b864be0260b849d52ed83fd9548239-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,723 INFO [StoreOpener-6ec0c5b097cecebaaef1c2fda1e810b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,724 DEBUG [StoreOpener-c1b864be0260b849d52ed83fd9548239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf 2023-07-16 06:11:43,724 DEBUG [StoreOpener-c1b864be0260b849d52ed83fd9548239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf 2023-07-16 06:11:43,724 DEBUG [StoreOpener-6ec0c5b097cecebaaef1c2fda1e810b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf 2023-07-16 06:11:43,724 DEBUG [StoreOpener-6ec0c5b097cecebaaef1c2fda1e810b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf 2023-07-16 06:11:43,724 INFO [StoreOpener-c1b864be0260b849d52ed83fd9548239-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1b864be0260b849d52ed83fd9548239 columnFamilyName cf 2023-07-16 06:11:43,724 INFO [StoreOpener-6ec0c5b097cecebaaef1c2fda1e810b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ec0c5b097cecebaaef1c2fda1e810b5 columnFamilyName cf 2023-07-16 06:11:43,725 INFO [StoreOpener-c1b864be0260b849d52ed83fd9548239-1] regionserver.HStore(310): Store=c1b864be0260b849d52ed83fd9548239/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:43,725 INFO [StoreOpener-6ec0c5b097cecebaaef1c2fda1e810b5-1] regionserver.HStore(310): Store=6ec0c5b097cecebaaef1c2fda1e810b5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:11:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c1b864be0260b849d52ed83fd9548239 2023-07-16 06:11:43,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:11:43,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:43,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:11:43,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ec0c5b097cecebaaef1c2fda1e810b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70467542, jitterRate=0.05004820227622986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:43,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c1b864be0260b849d52ed83fd9548239; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75207459, jitterRate=0.12067846953868866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:11:43,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ec0c5b097cecebaaef1c2fda1e810b5: 2023-07-16 06:11:43,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c1b864be0260b849d52ed83fd9548239: 2023-07-16 06:11:43,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5., pid=46, masterSystemTime=1689487903715 2023-07-16 06:11:43,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239., pid=45, masterSystemTime=1689487903714 2023-07-16 06:11:43,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:43,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:43,737 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c1b864be0260b849d52ed83fd9548239, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:43,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:43,737 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487903737"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487903737"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487903737"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487903737"}]},"ts":"1689487903737"} 2023-07-16 06:11:43,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:43,738 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6ec0c5b097cecebaaef1c2fda1e810b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:43,738 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487903738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487903738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487903738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487903738"}]},"ts":"1689487903738"} 2023-07-16 06:11:43,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-16 06:11:43,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure c1b864be0260b849d52ed83fd9548239, server=jenkins-hbase4.apache.org,35311,1689487858185 in 177 msec 2023-07-16 06:11:43,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-16 06:11:43,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 6ec0c5b097cecebaaef1c2fda1e810b5, server=jenkins-hbase4.apache.org,41391,1689487858033 in 177 msec 2023-07-16 06:11:43,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c1b864be0260b849d52ed83fd9548239, ASSIGN in 338 msec 2023-07-16 06:11:43,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-16 06:11:43,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6ec0c5b097cecebaaef1c2fda1e810b5, ASSIGN in 339 msec 2023-07-16 06:11:43,745 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:11:43,745 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487903745"}]},"ts":"1689487903745"} 2023-07-16 06:11:43,747 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-16 06:11:43,751 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:11:43,751 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-16 06:11:43,753 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 06:11:43,754 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:43,754 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:43,755 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:43,754 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:11:43,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:43,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:43,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:43,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 06:11:43,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 416 msec 2023-07-16 06:11:43,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 06:11:43,950 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-16 06:11:43,952 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 06:11:43,952 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:43,954 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:43,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:43,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487903966 (current time:1689487903966). 2023-07-16 06:11:43,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:43,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x08d6301e to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:43,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@585ae27d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:43,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:43,975 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:43,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d6301e to 127.0.0.1:58206 2023-07-16 06:11:43,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:43,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x3d1bb5e0 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:43,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@474249d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:43,986 DEBUG [hconnection-0xbb26764-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:43,989 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:43,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d1bb5e0 to 127.0.0.1:58206 2023-07-16 06:11:43,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:43,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 06:11:43,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:43,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:43,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:43,997 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:43,998 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689488503998 2023-07-16 06:11:43,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:43,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 06:11:43,999 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:43,999 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:44,003 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:44,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:44,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-16 06:11:44,005 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:44,006 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689488504005 2023-07-16 06:11:44,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,015 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-16 06:11:44,015 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:44,016 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 06:11:44,016 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 06:11:44,017 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,017 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,018 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,018 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,018 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,018 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,018 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,019 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,019 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,019 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:44,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,020 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:44,020 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:44,020 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:44,020 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:44,020 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:44,022 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:44,023 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:44,023 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:44,020 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:44,023 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:44,026 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:44,026 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:44,023 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:44,026 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:44,026 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:44,033 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,033 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,038 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,038 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,038 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,038 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,038 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,038 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 06:11:44,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36da361c[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 06:11:44,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36da361c[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:44,043 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 06:11:44,043 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:44,046 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:44,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:11:44,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,046 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:44,046 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:44,047 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,047 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:44,047 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:44,047 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:44,047 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:44,047 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:44,047 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:44,047 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:44,047 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. started... 2023-07-16 06:11:44,047 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. started... 2023-07-16 06:11:44,047 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ec0c5b097cecebaaef1c2fda1e810b5: 2023-07-16 06:11:44,049 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1b864be0260b849d52ed83fd9548239: 2023-07-16 06:11:44,049 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,049 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,049 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:44,050 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:44,050 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:44,050 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:11:44,051 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:44,051 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:44,051 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:44,067 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. completed. 2023-07-16 06:11:44,067 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:44,067 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. completed. 2023-07-16 06:11:44,067 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:44,067 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:44,067 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:44,067 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,068 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:44,068 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:44,068 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,068 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:44,068 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:44,068 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:11:44,068 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:11:44,070 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:44,070 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:44,070 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,070 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,070 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:44,071 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:44,071 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,071 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35311,1689487858185': 2023-07-16 06:11:44,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 06:11:44,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:11:44,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 06:11:44,080 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-16 06:11:44,081 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:44,081 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:44,082 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,082 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:44,084 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,085 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,084 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,085 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,086 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,086 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,089 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,089 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,089 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,092 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,092 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,092 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,092 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,092 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,093 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,093 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,093 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,093 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,093 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,095 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-16 06:11:44,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,095 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,095 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:11:44,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,095 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,096 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,096 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,096 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,096 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,096 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 06:11:44,099 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:44,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 06:11:44,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:44,101 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:44,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 06:11:44,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,147 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 06:11:44,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689487903998Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689487904104 (+106 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689487904104Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689487904104Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689487904109 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689487904120 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689487904147 (+27 ms) 2023-07-16 06:11:44,150 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:44,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 151 msec 2023-07-16 06:11:44,301 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:44,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 06:11:44,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:44,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41391] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:44,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35311] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:11:44,310 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 06:11:44,311 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:44,311 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:11:44,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:44,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487904322 (current time:1689487904322). 2023-07-16 06:11:44,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:11:44,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x6c149fd7 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:44,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d388439, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:44,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:44,340 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:44,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c149fd7 to 127.0.0.1:58206 2023-07-16 06:11:44,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:44,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x5bdb4012 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:11:44,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13f98699, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:11:44,356 DEBUG [hconnection-0x1ae9c193-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:11:44,358 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:11:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bdb4012 to 127.0.0.1:58206 2023-07-16 06:11:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:11:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 06:11:44,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:11:44,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:44,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:44,370 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:44,371 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689488504371 2023-07-16 06:11:44,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 06:11:44,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 06:11:44,373 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:11:44,373 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:11:44,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:44,375 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 06:11:44,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-16 06:11:44,377 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:44,379 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689488504379 2023-07-16 06:11:44,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-16 06:11:44,403 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-16 06:11:44,403 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:44,405 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 06:11:44,405 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 06:11:44,406 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,406 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,407 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,407 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,407 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,407 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,408 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,408 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,408 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,408 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:11:44,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:44,409 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 06:11:44,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 06:11:44,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 06:11:44,410 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:44,410 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:44,410 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:44,410 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:44,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 06:11:44,412 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:44,412 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 06:11:44,412 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:11:44,412 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:44,412 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:44,413 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:44,413 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:44,413 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 06:11:44,413 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:44,413 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 06:11:44,414 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 06:11:44,416 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,417 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,417 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:11:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 06:11:44,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46fba5fd[Count = 1] remaining members to acquire global barrier 2023-07-16 06:11:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 06:11:44,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46fba5fd[Count = 0] remaining members to acquire global barrier 2023-07-16 06:11:44,421 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 06:11:44,421 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,422 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,422 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,422 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,423 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:44,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,423 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,423 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:44,423 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 06:11:44,423 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:44,423 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:11:44,423 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,423 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:11:44,424 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:44,424 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:44,425 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:44,428 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:44,428 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:44,428 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:44,428 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:11:44,428 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:11:44,428 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. started... 2023-07-16 06:11:44,428 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:44,428 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. started... 2023-07-16 06:11:44,428 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ec0c5b097cecebaaef1c2fda1e810b5 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 06:11:44,428 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c1b864be0260b849d52ed83fd9548239 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 06:11:44,464 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071657738dfef1d8425a91ae8e906c38199c to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071657738dfef1d8425a91ae8e906c38199c 2023-07-16 06:11:44,466 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716a2db2fd5c3974a838cb5e03a7e6de39a to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716a2db2fd5c3974a838cb5e03a7e6de39a 2023-07-16 06:11:44,474 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:44,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 06:11:44,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:11:44,482 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:11:44,485 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/.tmp/cf/6948625915054e62b6499adfa4576b9e 2023-07-16 06:11:44,490 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/.tmp/cf/d71b222fe4374ff1a5df9bab9560826c 2023-07-16 06:11:44,492 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/.tmp/cf/6948625915054e62b6499adfa4576b9e as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf/6948625915054e62b6499adfa4576b9e 2023-07-16 06:11:44,497 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/.tmp/cf/d71b222fe4374ff1a5df9bab9560826c as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf/d71b222fe4374ff1a5df9bab9560826c 2023-07-16 06:11:44,499 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf/6948625915054e62b6499adfa4576b9e, entries=47, sequenceid=6, filesize=12.7 K 2023-07-16 06:11:44,500 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c1b864be0260b849d52ed83fd9548239 in 72ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:44,500 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 06:11:44,500 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1b864be0260b849d52ed83fd9548239: 2023-07-16 06:11:44,500 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:44,501 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:44,501 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf/6948625915054e62b6499adfa4576b9e] hfiles 2023-07-16 06:11:44,501 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf/6948625915054e62b6499adfa4576b9e for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:44,503 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf/d71b222fe4374ff1a5df9bab9560826c, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 06:11:44,504 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 6ec0c5b097cecebaaef1c2fda1e810b5 in 76ms, sequenceid=6, compaction requested=false 2023-07-16 06:11:44,506 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ec0c5b097cecebaaef1c2fda1e810b5: 2023-07-16 06:11:44,506 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:44,506 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:11:44,506 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf/d71b222fe4374ff1a5df9bab9560826c] hfiles 2023-07-16 06:11:44,506 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf/d71b222fe4374ff1a5df9bab9560826c for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:44,515 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. completed. 2023-07-16 06:11:44,515 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:11:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:44,519 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:11:44,522 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:44,524 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. completed. 2023-07-16 06:11:44,524 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:11:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:11:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:11:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 06:11:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:11:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,526 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 06:11:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,526 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:44,526 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,526 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 06:11:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35311,1689487858185': 2023-07-16 06:11:44,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 06:11:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:11:44,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 06:11:44,533 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-16 06:11:44,533 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:11:44,533 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:11:44,533 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-16 06:11:44,533 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:11:44,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:11:44,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:11:44,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,536 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,536 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:11:44,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,537 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:11:44,539 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 06:11:44,540 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,540 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:11:44,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-16 06:11:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,547 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:11:44,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:11:44,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:11:44,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:11:44,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:11:44,550 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,550 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,550 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:11:44,550 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,550 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:11:44,550 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:11:44,550 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,550 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071657738dfef1d8425a91ae8e906c38199c, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716a2db2fd5c3974a838cb5e03a7e6de39a] mob files 2023-07-16 06:11:44,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071657738dfef1d8425a91ae8e906c38199c 2023-07-16 06:11:44,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716a2db2fd5c3974a838cb5e03a7e6de39a 2023-07-16 06:11:44,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:11:44,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:11:44,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-16 06:11:44,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 06:11:44,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,608 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689487904371Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689487904562 (+191 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689487904562Loading Region manifests for snaptb0-testConsecutiveExports at 1689487904562Writing data manifest for snaptb0-testConsecutiveExports at 1689487904566 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689487904578 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689487904607 (+29 ms) 2023-07-16 06:11:44,610 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 06:11:44,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 238 msec 2023-07-16 06:11:44,682 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:11:44,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 06:11:44,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:11:44,683 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683 2023-07-16 06:11:44,683 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683, srcFsUri=hdfs://localhost:37171, srcDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:44,706 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:44,707 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@72f1ef29, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,707 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2, snapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 06:11:44,715 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:44,727 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,727 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,728 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,728 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,728 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,728 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,729 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,798 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop-8041108757869915339.jar 2023-07-16 06:11:44,799 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,799 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,800 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,800 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,800 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,801 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:44,801 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:11:44,801 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:11:44,802 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:11:44,802 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:11:44,802 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:11:44,803 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:11:44,803 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:11:44,804 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:11:44,804 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:11:44,804 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:11:44,805 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:44,805 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:44,806 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:44,806 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:44,806 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:44,807 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:44,807 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:45,182 WARN [Listener at jenkins-hbase4.apache.org/41271] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:11:45,184 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 06:11:45,186 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-16 06:11:47,586 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:47,586 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:11:47,589 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0002_000001 (auth:SIMPLE) 2023-07-16 06:11:48,368 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0003_000001 (auth:SIMPLE) 2023-07-16 06:11:48,641 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:11:52,604 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0003_000001 (auth:SIMPLE) 2023-07-16 06:11:54,877 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0003_000001 (auth:SIMPLE) 2023-07-16 06:11:57,432 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0003_000001 (auth:SIMPLE) 2023-07-16 06:11:59,365 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:11:59,366 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:11:59,370 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 06:11:59,370 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:11:59,371 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:11:59,371 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:11:59,374 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 06:11:59,374 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 06:11:59,374 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@db78aa9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:11:59,374 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 06:11:59,374 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 06:11:59,376 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683, srcFsUri=hdfs://localhost:37171, srcDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:59,397 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:11:59,397 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7e7b914d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:59,398 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2, snapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 06:11:59,409 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 06:11:59,421 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,421 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,421 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,422 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,422 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,422 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,423 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,490 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop-9028451843021810657.jar 2023-07-16 06:11:59,490 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,491 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,491 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,491 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,492 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,492 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:11:59,492 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:11:59,493 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:11:59,493 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:11:59,494 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:11:59,494 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:11:59,494 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:11:59,495 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:11:59,495 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:11:59,495 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:11:59,496 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:11:59,496 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:59,496 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:59,497 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:59,497 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:59,497 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:11:59,498 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:59,498 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:11:59,894 WARN [Listener at jenkins-hbase4.apache.org/41271] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:11:59,897 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 06:11:59,899 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-16 06:12:03,606 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:03,606 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:03,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0003_000001 (auth:SIMPLE) 2023-07-16 06:12:04,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:08,746 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:11,044 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:13,744 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:15,153 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:12:15,154 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:12:15,179 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 06:12:15,179 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:12:15,180 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:12:15,180 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:12:15,184 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 06:12:15,184 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 06:12:15,184 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@db78aa9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 06:12:15,185 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 06:12:15,185 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/local-export-1689487904683/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 06:12:15,211 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-16 06:12:15,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-16 06:12:15,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:15,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487935218"}]},"ts":"1689487935218"} 2023-07-16 06:12:15,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 06:12:15,220 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-16 06:12:15,222 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-16 06:12:15,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6ec0c5b097cecebaaef1c2fda1e810b5, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c1b864be0260b849d52ed83fd9548239, UNASSIGN}] 2023-07-16 06:12:15,226 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c1b864be0260b849d52ed83fd9548239, UNASSIGN 2023-07-16 06:12:15,226 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6ec0c5b097cecebaaef1c2fda1e810b5, UNASSIGN 2023-07-16 06:12:15,227 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c1b864be0260b849d52ed83fd9548239, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:15,227 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6ec0c5b097cecebaaef1c2fda1e810b5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:15,227 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487935227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487935227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487935227"}]},"ts":"1689487935227"} 2023-07-16 06:12:15,228 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487935227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487935227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487935227"}]},"ts":"1689487935227"} 2023-07-16 06:12:15,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure c1b864be0260b849d52ed83fd9548239, server=jenkins-hbase4.apache.org,35311,1689487858185}] 2023-07-16 06:12:15,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 6ec0c5b097cecebaaef1c2fda1e810b5, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:15,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 06:12:15,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c1b864be0260b849d52ed83fd9548239 2023-07-16 06:12:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c1b864be0260b849d52ed83fd9548239, disabling compactions & flushes 2023-07-16 06:12:15,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:12:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:12:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. after waiting 0 ms 2023-07-16 06:12:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:12:15,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:12:15,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ec0c5b097cecebaaef1c2fda1e810b5, disabling compactions & flushes 2023-07-16 06:12:15,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:12:15,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:12:15,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. after waiting 0 ms 2023-07-16 06:12:15,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:12:15,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:15,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:15,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5. 2023-07-16 06:12:15,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ec0c5b097cecebaaef1c2fda1e810b5: 2023-07-16 06:12:15,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:12:15,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6ec0c5b097cecebaaef1c2fda1e810b5, regionState=CLOSED 2023-07-16 06:12:15,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487935430"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487935430"}]},"ts":"1689487935430"} 2023-07-16 06:12:15,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:15,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:15,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239. 2023-07-16 06:12:15,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c1b864be0260b849d52ed83fd9548239: 2023-07-16 06:12:15,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-16 06:12:15,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 6ec0c5b097cecebaaef1c2fda1e810b5, server=jenkins-hbase4.apache.org,41391,1689487858033 in 201 msec 2023-07-16 06:12:15,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c1b864be0260b849d52ed83fd9548239 2023-07-16 06:12:15,435 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c1b864be0260b849d52ed83fd9548239, regionState=CLOSED 2023-07-16 06:12:15,436 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689487935435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487935435"}]},"ts":"1689487935435"} 2023-07-16 06:12:15,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6ec0c5b097cecebaaef1c2fda1e810b5, UNASSIGN in 212 msec 2023-07-16 06:12:15,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-16 06:12:15,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure c1b864be0260b849d52ed83fd9548239, server=jenkins-hbase4.apache.org,35311,1689487858185 in 213 msec 2023-07-16 06:12:15,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-16 06:12:15,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c1b864be0260b849d52ed83fd9548239, UNASSIGN in 222 msec 2023-07-16 06:12:15,449 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487935448"}]},"ts":"1689487935448"} 2023-07-16 06:12:15,451 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-16 06:12:15,453 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-16 06:12:15,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 241 msec 2023-07-16 06:12:15,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 06:12:15,524 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-16 06:12:15,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-16 06:12:15,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:15,529 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:15,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-16 06:12:15,531 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:15,538 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-16 06:12:15,541 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:12:15,542 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239 2023-07-16 06:12:15,545 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:15,545 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:15,545 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:15,545 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:15,546 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/recovered.edits] 2023-07-16 06:12:15,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 06:12:15,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 06:12:15,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 06:12:15,546 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/recovered.edits] 2023-07-16 06:12:15,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:15,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:15,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:15,548 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:15,548 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:15,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-16 06:12:15,548 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:12:15,547 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 06:12:15,548 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:15,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 06:12:15,557 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf/d71b222fe4374ff1a5df9bab9560826c to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/cf/d71b222fe4374ff1a5df9bab9560826c 2023-07-16 06:12:15,557 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf/6948625915054e62b6499adfa4576b9e to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/cf/6948625915054e62b6499adfa4576b9e 2023-07-16 06:12:15,562 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5/recovered.edits/9.seqid 2023-07-16 06:12:15,562 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239/recovered.edits/9.seqid 2023-07-16 06:12:15,563 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/6ec0c5b097cecebaaef1c2fda1e810b5 2023-07-16 06:12:15,563 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testConsecutiveExports/c1b864be0260b849d52ed83fd9548239 2023-07-16 06:12:15,563 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 06:12:15,564 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-16 06:12:15,565 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-16 06:12:15,572 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071657738dfef1d8425a91ae8e906c38199c to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071657738dfef1d8425a91ae8e906c38199c 2023-07-16 06:12:15,574 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716a2db2fd5c3974a838cb5e03a7e6de39a to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716a2db2fd5c3974a838cb5e03a7e6de39a 2023-07-16 06:12:15,574 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-16 06:12:15,577 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:15,581 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-16 06:12:15,584 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-16 06:12:15,585 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:15,585 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-16 06:12:15,585 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487935585"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:15,586 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487935585"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:15,588 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:12:15,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ec0c5b097cecebaaef1c2fda1e810b5, NAME => 'testtb-testConsecutiveExports,,1689487903340.6ec0c5b097cecebaaef1c2fda1e810b5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c1b864be0260b849d52ed83fd9548239, NAME => 'testtb-testConsecutiveExports,1,1689487903340.c1b864be0260b849d52ed83fd9548239.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:12:15,588 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-16 06:12:15,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487935588"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:15,590 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-16 06:12:15,596 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 06:12:15,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 71 msec 2023-07-16 06:12:15,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 06:12:15,652 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-16 06:12:15,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-16 06:12:15,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-16 06:12:15,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-16 06:12:15,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-16 06:12:15,726 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 764), OpenFileDescriptor=900 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=446 (was 407) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=3107 (was 2827) - AvailableMemoryMB LEAK? - 2023-07-16 06:12:15,727 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-16 06:12:15,757 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=446, ProcessCount=182, AvailableMemoryMB=3095 2023-07-16 06:12:15,757 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-16 06:12:15,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 06:12:15,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:15,769 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:12:15,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-16 06:12:15,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 06:12:15,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:12:15,775 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:15,780 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:15,780 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d empty. 2023-07-16 06:12:15,782 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:15,782 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83 empty. 2023-07-16 06:12:15,783 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:15,783 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 06:12:15,803 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-16 06:12:15,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => e12afd8e285ecb186a206ca46491904d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:12:15,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2395e777d8c360dfd11567f781a08b83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:12:15,859 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:15,859 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 2395e777d8c360dfd11567f781a08b83, disabling compactions & flushes 2023-07-16 06:12:15,859 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:15,860 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:15,860 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. after waiting 0 ms 2023-07-16 06:12:15,860 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:15,860 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:15,860 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 2395e777d8c360dfd11567f781a08b83: 2023-07-16 06:12:15,862 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:15,862 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing e12afd8e285ecb186a206ca46491904d, disabling compactions & flushes 2023-07-16 06:12:15,862 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:15,862 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:15,862 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. after waiting 0 ms 2023-07-16 06:12:15,862 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:15,862 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:15,862 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for e12afd8e285ecb186a206ca46491904d: 2023-07-16 06:12:15,866 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:12:15,868 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487935867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487935867"}]},"ts":"1689487935867"} 2023-07-16 06:12:15,868 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487935867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487935867"}]},"ts":"1689487935867"} 2023-07-16 06:12:15,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 06:12:15,886 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:12:15,889 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:12:15,889 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487935889"}]},"ts":"1689487935889"} 2023-07-16 06:12:15,892 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-16 06:12:15,896 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:12:15,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:12:15,899 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:12:15,899 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:12:15,899 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:12:15,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e12afd8e285ecb186a206ca46491904d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2395e777d8c360dfd11567f781a08b83, ASSIGN}] 2023-07-16 06:12:15,903 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2395e777d8c360dfd11567f781a08b83, ASSIGN 2023-07-16 06:12:15,903 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e12afd8e285ecb186a206ca46491904d, ASSIGN 2023-07-16 06:12:15,904 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e12afd8e285ecb186a206ca46491904d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34953,1689487858121; forceNewPlan=false, retain=false 2023-07-16 06:12:15,904 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2395e777d8c360dfd11567f781a08b83, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:12:16,055 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:12:16,059 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e12afd8e285ecb186a206ca46491904d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,059 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2395e777d8c360dfd11567f781a08b83, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,059 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487936059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487936059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487936059"}]},"ts":"1689487936059"} 2023-07-16 06:12:16,059 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487936059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487936059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487936059"}]},"ts":"1689487936059"} 2023-07-16 06:12:16,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure e12afd8e285ecb186a206ca46491904d, server=jenkins-hbase4.apache.org,34953,1689487858121}] 2023-07-16 06:12:16,067 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 2395e777d8c360dfd11567f781a08b83, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:16,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 06:12:16,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:16,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2395e777d8c360dfd11567f781a08b83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:12:16,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:16,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e12afd8e285ecb186a206ca46491904d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:12:16,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. service=AccessControlService 2023-07-16 06:12:16,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:16,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. service=AccessControlService 2023-07-16 06:12:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:16,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:16,231 INFO [StoreOpener-2395e777d8c360dfd11567f781a08b83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:16,233 DEBUG [StoreOpener-2395e777d8c360dfd11567f781a08b83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf 2023-07-16 06:12:16,233 DEBUG [StoreOpener-2395e777d8c360dfd11567f781a08b83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf 2023-07-16 06:12:16,235 INFO [StoreOpener-2395e777d8c360dfd11567f781a08b83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2395e777d8c360dfd11567f781a08b83 columnFamilyName cf 2023-07-16 06:12:16,236 INFO [StoreOpener-2395e777d8c360dfd11567f781a08b83-1] regionserver.HStore(310): Store=2395e777d8c360dfd11567f781a08b83/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:16,255 INFO [StoreOpener-e12afd8e285ecb186a206ca46491904d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:16,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:16,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:16,258 DEBUG [StoreOpener-e12afd8e285ecb186a206ca46491904d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf 2023-07-16 06:12:16,259 DEBUG [StoreOpener-e12afd8e285ecb186a206ca46491904d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf 2023-07-16 06:12:16,259 INFO [StoreOpener-e12afd8e285ecb186a206ca46491904d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e12afd8e285ecb186a206ca46491904d columnFamilyName cf 2023-07-16 06:12:16,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:16,261 INFO [StoreOpener-e12afd8e285ecb186a206ca46491904d-1] regionserver.HStore(310): Store=e12afd8e285ecb186a206ca46491904d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:16,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:16,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:16,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:16,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:16,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e12afd8e285ecb186a206ca46491904d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64869925, jitterRate=-0.03336279094219208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:16,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e12afd8e285ecb186a206ca46491904d: 2023-07-16 06:12:16,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d., pid=60, masterSystemTime=1689487936219 2023-07-16 06:12:16,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:16,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:16,274 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e12afd8e285ecb186a206ca46491904d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:16,275 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487936274"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487936274"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487936274"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487936274"}]},"ts":"1689487936274"} 2023-07-16 06:12:16,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2395e777d8c360dfd11567f781a08b83; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72029127, jitterRate=0.07331763207912445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:16,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2395e777d8c360dfd11567f781a08b83: 2023-07-16 06:12:16,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83., pid=61, masterSystemTime=1689487936219 2023-07-16 06:12:16,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:16,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:16,279 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2395e777d8c360dfd11567f781a08b83, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,279 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487936279"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487936279"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487936279"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487936279"}]},"ts":"1689487936279"} 2023-07-16 06:12:16,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-16 06:12:16,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure e12afd8e285ecb186a206ca46491904d, server=jenkins-hbase4.apache.org,34953,1689487858121 in 211 msec 2023-07-16 06:12:16,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e12afd8e285ecb186a206ca46491904d, ASSIGN in 381 msec 2023-07-16 06:12:16,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-16 06:12:16,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 2395e777d8c360dfd11567f781a08b83, server=jenkins-hbase4.apache.org,41391,1689487858033 in 214 msec 2023-07-16 06:12:16,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-16 06:12:16,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2395e777d8c360dfd11567f781a08b83, ASSIGN in 384 msec 2023-07-16 06:12:16,287 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:12:16,287 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487936287"}]},"ts":"1689487936287"} 2023-07-16 06:12:16,290 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-16 06:12:16,293 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:12:16,293 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-16 06:12:16,295 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 06:12:16,296 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:16,297 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:16,297 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:16,297 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:16,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:16,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:16,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:16,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:16,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 540 msec 2023-07-16 06:12:16,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 06:12:16,375 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-16 06:12:16,378 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,378 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:16,380 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:16,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:16,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487936405 (current time:1689487936405). 2023-07-16 06:12:16,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:16,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x03144992 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:16,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@105993f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:16,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:16,420 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:16,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03144992 to 127.0.0.1:58206 2023-07-16 06:12:16,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:16,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x491589e3 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:16,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@686c118a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:16,546 DEBUG [hconnection-0x34f6e952-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:16,553 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x491589e3 to 127.0.0.1:58206 2023-07-16 06:12:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 06:12:16,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:16,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:16,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:16,571 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:16,573 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689488536573 2023-07-16 06:12:16,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:16,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,574 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:16,577 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:16,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:16,589 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:16,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 21 msec 2023-07-16 06:12:16,592 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:16,593 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689488536593 2023-07-16 06:12:16,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,635 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 06:12:16,635 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:16,636 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 06:12:16,636 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 06:12:16,637 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,637 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,640 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,640 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,640 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,640 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,641 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,641 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,642 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,642 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:16,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 06:12:16,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:16,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 06:12:16,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:16,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,643 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:16,643 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:16,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 06:12:16,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,644 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:16,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,659 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:16,659 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:16,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,662 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:16,662 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:16,662 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:16,662 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:16,664 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:16,664 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:16,662 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:16,664 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:16,668 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,668 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,668 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,668 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:16,673 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,674 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,675 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,675 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,675 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:16,675 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,675 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:16,677 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:16,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:16,679 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 06:12:16,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@473fa00[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 06:12:16,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@473fa00[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:16,684 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 06:12:16,684 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:16,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,686 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:12:16,687 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:16,686 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:16,687 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,692 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:16,692 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,692 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:16,692 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:16,692 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:16,699 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:16,699 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:16,699 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:16,708 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. started... 2023-07-16 06:12:16,708 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e12afd8e285ecb186a206ca46491904d: 2023-07-16 06:12:16,709 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,709 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:16,709 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:16,722 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:16,723 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:16,723 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:16,723 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. started... 2023-07-16 06:12:16,725 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2395e777d8c360dfd11567f781a08b83: 2023-07-16 06:12:16,725 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,725 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:16,725 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:16,788 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. completed. 2023-07-16 06:12:16,788 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:16,788 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:16,788 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:16,788 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,788 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:16,788 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:12:16,789 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. completed. 2023-07-16 06:12:16,789 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:16,789 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:16,789 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:16,789 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,789 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:12:16,790 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:16,790 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:16,792 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,792 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:16,792 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:16,792 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:16,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34953,1689487858121': 2023-07-16 06:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 06:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:12:16,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 06:12:16,800 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 06:12:16,801 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:16,801 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:16,801 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,801 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:16,802 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,802 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,802 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,803 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,802 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,802 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,802 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:16,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:16,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,803 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:16,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,804 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,804 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:16,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:16,806 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,807 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,807 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,811 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,811 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,811 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,811 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,811 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,812 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,811 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,812 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:12:16,812 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:16,811 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,812 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,813 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:16,813 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:16,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 06:12:16,814 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:16,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:16,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,814 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:16,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,815 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,815 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:16,815 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:16,815 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:16,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:16,815 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,879 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:16,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:16,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:16,881 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:16,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 06:12:16,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,909 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:16,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689487936573Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689487936824 (+251 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689487936824Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689487936824Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689487936829 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689487936841 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689487936909 (+68 ms) 2023-07-16 06:12:16,912 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:16,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 337 msec 2023-07-16 06:12:17,181 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:17,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:17,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:17,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34953] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:17,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41391] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:17,203 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,203 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:17,204 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:17,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:17,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487937230 (current time:1689487937230). 2023-07-16 06:12:17,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:17,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x4f3f5bdf to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:17,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@517daf73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:17,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:17,245 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:17,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f3f5bdf to 127.0.0.1:58206 2023-07-16 06:12:17,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:17,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x1c92948f to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:17,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2946c561, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:17,266 DEBUG [hconnection-0x15fce10d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:17,269 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:17,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c92948f to 127.0.0.1:58206 2023-07-16 06:12:17,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:17,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 06:12:17,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:17,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:17,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:17,280 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:17,281 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689488537281 2023-07-16 06:12:17,281 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 06:12:17,282 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:17,282 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:17,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:17,283 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 06:12:17,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-16 06:12:17,286 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:17,287 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689488537287 2023-07-16 06:12:17,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,305 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 06:12:17,305 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:17,306 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 06:12:17,306 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 06:12:17,307 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,307 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,308 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,308 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:17,308 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:17,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:17,308 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:17,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:17,309 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,309 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,309 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,309 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:17,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:17,310 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 06:12:17,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,311 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:17,311 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:17,316 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:17,316 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:17,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,316 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:17,316 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:17,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,316 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 06:12:17,316 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:17,316 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:17,318 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:17,319 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 06:12:17,319 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:17,319 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 06:12:17,319 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:17,319 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 06:12:17,320 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:17,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:17,320 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,322 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,322 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,322 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,322 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:17,322 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:17,323 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:17,323 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,323 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:17,323 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:17,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:17,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 06:12:17,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@376b61ee[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:17,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 06:12:17,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@376b61ee[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:17,327 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 06:12:17,327 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,328 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,328 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,328 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,329 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:17,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,329 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:17,329 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:17,329 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,329 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. started... 2023-07-16 06:12:17,329 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 06:12:17,329 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:17,329 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:17,329 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:17,329 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:12:17,329 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,329 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2395e777d8c360dfd11567f781a08b83 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 06:12:17,329 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:17,330 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:17,330 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:17,330 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:17,330 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. started... 2023-07-16 06:12:17,330 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e12afd8e285ecb186a206ca46491904d 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 06:12:17,331 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:17,331 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:17,331 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:17,376 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307160343753c30b64940ac99545ad201ca0e to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307160343753c30b64940ac99545ad201ca0e 2023-07-16 06:12:17,378 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307169c046496e6b9498495f2bed0a975b592 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307169c046496e6b9498495f2bed0a975b592 2023-07-16 06:12:17,382 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:17,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:17,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:17,384 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:17,407 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/.tmp/cf/6d14f2dbd18744d5825ee96426109148 2023-07-16 06:12:17,423 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/.tmp/cf/6d14f2dbd18744d5825ee96426109148 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf/6d14f2dbd18744d5825ee96426109148 2023-07-16 06:12:17,433 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf/6d14f2dbd18744d5825ee96426109148, entries=45, sequenceid=6, filesize=13.2 K 2023-07-16 06:12:17,434 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 2395e777d8c360dfd11567f781a08b83 in 105ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:17,435 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-16 06:12:17,435 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2395e777d8c360dfd11567f781a08b83: 2023-07-16 06:12:17,436 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,436 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:17,436 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf/6d14f2dbd18744d5825ee96426109148] hfiles 2023-07-16 06:12:17,436 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf/6d14f2dbd18744d5825ee96426109148 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,451 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. completed. 2023-07-16 06:12:17,453 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:12:17,455 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/.tmp/cf/0243b399b9e4446d8d10c49cf87d42a8 2023-07-16 06:12:17,455 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:17,455 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:17,455 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:17,458 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:12:17,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 06:12:17,470 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/.tmp/cf/0243b399b9e4446d8d10c49cf87d42a8 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf/0243b399b9e4446d8d10c49cf87d42a8 2023-07-16 06:12:17,478 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf/0243b399b9e4446d8d10c49cf87d42a8, entries=5, sequenceid=6, filesize=5.8 K 2023-07-16 06:12:17,479 INFO [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for e12afd8e285ecb186a206ca46491904d in 149ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:17,481 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e12afd8e285ecb186a206ca46491904d: 2023-07-16 06:12:17,481 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,481 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:17,481 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf/0243b399b9e4446d8d10c49cf87d42a8] hfiles 2023-07-16 06:12:17,482 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf/0243b399b9e4446d8d10c49cf87d42a8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,489 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. completed. 2023-07-16 06:12:17,489 DEBUG [rs(jenkins-hbase4.apache.org,34953,1689487858121)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:17,489 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:17,489 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:17,489 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,489 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 06:12:17,489 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:12:17,492 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,492 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 06:12:17,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:17,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:17,492 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:17,492 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 06:12:17,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:17,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:17,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34953,1689487858121': 2023-07-16 06:12:17,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 06:12:17,498 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 06:12:17,498 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:17,498 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:17,498 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,498 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:17,503 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:17,503 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:17,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:17,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:17,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,503 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,503 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:17,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:17,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:17,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,504 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,505 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:17,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,507 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,507 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,508 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:17,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:17,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:17,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:17,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:17,511 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:17,511 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:17,511 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,513 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,513 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,513 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:17,513 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,513 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:17,513 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:17,513 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,513 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:17,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:17,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:17,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:17,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:17,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:12:17,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:17,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:17,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307160343753c30b64940ac99545ad201ca0e, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307169c046496e6b9498495f2bed0a975b592] mob files 2023-07-16 06:12:17,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307160343753c30b64940ac99545ad201ca0e 2023-07-16 06:12:17,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307169c046496e6b9498495f2bed0a975b592 2023-07-16 06:12:17,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,584 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:17,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:17,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:17,586 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:17,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 06:12:17,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,713 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:17,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689487937281Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689487937529 (+248 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689487937529Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689487937529Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689487937540 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689487937592 (+52 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689487937712 (+120 ms) 2023-07-16 06:12:17,716 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 06:12:17,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 434 msec 2023-07-16 06:12:17,887 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:17,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 06:12:17,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:17,938 DEBUG [Listener at jenkins-hbase4.apache.org/41271] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:12:17,950 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:12:17,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34953] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 06:12:17,954 DEBUG [Listener at jenkins-hbase4.apache.org/41271] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:12:17,959 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:12:17,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35311] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 06:12:17,960 DEBUG [Listener at jenkins-hbase4.apache.org/41271] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 06:12:17,985 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 06:12:17,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41391] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 06:12:17,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 06:12:17,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:17,999 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:12:18,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-16 06:12:18,000 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:12:18,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 06:12:18,019 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,020 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,020 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38 empty. 2023-07-16 06:12:18,021 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061 empty. 2023-07-16 06:12:18,021 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,021 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,021 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 06:12:18,057 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-16 06:12:18,059 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5da59321dfa76a73dddd89898830af38, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:12:18,067 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 24a40aa98b8feb4889cc331016085061, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:12:18,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 06:12:18,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:18,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 5da59321dfa76a73dddd89898830af38, disabling compactions & flushes 2023-07-16 06:12:18,103 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. after waiting 0 ms 2023-07-16 06:12:18,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,103 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 5da59321dfa76a73dddd89898830af38: 2023-07-16 06:12:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 24a40aa98b8feb4889cc331016085061, disabling compactions & flushes 2023-07-16 06:12:18,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. after waiting 0 ms 2023-07-16 06:12:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,105 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 24a40aa98b8feb4889cc331016085061: 2023-07-16 06:12:18,108 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:12:18,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487938109"}]},"ts":"1689487938109"} 2023-07-16 06:12:18,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487938109"}]},"ts":"1689487938109"} 2023-07-16 06:12:18,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:12:18,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:12:18,113 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487938113"}]},"ts":"1689487938113"} 2023-07-16 06:12:18,115 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-16 06:12:18,119 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:12:18,120 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:12:18,120 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:12:18,120 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:12:18,120 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:12:18,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5da59321dfa76a73dddd89898830af38, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=24a40aa98b8feb4889cc331016085061, ASSIGN}] 2023-07-16 06:12:18,124 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=24a40aa98b8feb4889cc331016085061, ASSIGN 2023-07-16 06:12:18,124 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5da59321dfa76a73dddd89898830af38, ASSIGN 2023-07-16 06:12:18,125 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=24a40aa98b8feb4889cc331016085061, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34953,1689487858121; forceNewPlan=false, retain=false 2023-07-16 06:12:18,125 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5da59321dfa76a73dddd89898830af38, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:12:18,275 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:12:18,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5da59321dfa76a73dddd89898830af38, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:18,279 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487938278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487938278"}]},"ts":"1689487938278"} 2023-07-16 06:12:18,279 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=24a40aa98b8feb4889cc331016085061, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:18,279 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938279"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487938279"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487938279"}]},"ts":"1689487938279"} 2023-07-16 06:12:18,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 5da59321dfa76a73dddd89898830af38, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:18,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 24a40aa98b8feb4889cc331016085061, server=jenkins-hbase4.apache.org,34953,1689487858121}] 2023-07-16 06:12:18,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 06:12:18,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5da59321dfa76a73dddd89898830af38, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.', STARTKEY => '', ENDKEY => '2'} 2023-07-16 06:12:18,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. service=AccessControlService 2023-07-16 06:12:18,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:18,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:18,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,440 INFO [StoreOpener-5da59321dfa76a73dddd89898830af38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 24a40aa98b8feb4889cc331016085061, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.', STARTKEY => '2', ENDKEY => ''} 2023-07-16 06:12:18,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. service=AccessControlService 2023-07-16 06:12:18,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:18,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:18,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,443 DEBUG [StoreOpener-5da59321dfa76a73dddd89898830af38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf 2023-07-16 06:12:18,443 DEBUG [StoreOpener-5da59321dfa76a73dddd89898830af38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf 2023-07-16 06:12:18,444 INFO [StoreOpener-24a40aa98b8feb4889cc331016085061-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,444 INFO [StoreOpener-5da59321dfa76a73dddd89898830af38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5da59321dfa76a73dddd89898830af38 columnFamilyName cf 2023-07-16 06:12:18,444 INFO [StoreOpener-5da59321dfa76a73dddd89898830af38-1] regionserver.HStore(310): Store=5da59321dfa76a73dddd89898830af38/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:18,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,445 DEBUG [StoreOpener-24a40aa98b8feb4889cc331016085061-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf 2023-07-16 06:12:18,446 DEBUG [StoreOpener-24a40aa98b8feb4889cc331016085061-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf 2023-07-16 06:12:18,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,446 INFO [StoreOpener-24a40aa98b8feb4889cc331016085061-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24a40aa98b8feb4889cc331016085061 columnFamilyName cf 2023-07-16 06:12:18,447 INFO [StoreOpener-24a40aa98b8feb4889cc331016085061-1] regionserver.HStore(310): Store=24a40aa98b8feb4889cc331016085061/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:18,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:18,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5da59321dfa76a73dddd89898830af38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75274767, jitterRate=0.12168143689632416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:18,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5da59321dfa76a73dddd89898830af38: 2023-07-16 06:12:18,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38., pid=69, masterSystemTime=1689487938434 2023-07-16 06:12:18,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:18,454 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5da59321dfa76a73dddd89898830af38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:18,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 24a40aa98b8feb4889cc331016085061; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68849201, jitterRate=0.02593304216861725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:18,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 24a40aa98b8feb4889cc331016085061: 2023-07-16 06:12:18,455 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938454"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487938454"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487938454"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487938454"}]},"ts":"1689487938454"} 2023-07-16 06:12:18,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061., pid=70, masterSystemTime=1689487938438 2023-07-16 06:12:18,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,458 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=24a40aa98b8feb4889cc331016085061, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:18,458 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938457"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487938457"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487938457"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487938457"}]},"ts":"1689487938457"} 2023-07-16 06:12:18,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-16 06:12:18,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 5da59321dfa76a73dddd89898830af38, server=jenkins-hbase4.apache.org,41391,1689487858033 in 175 msec 2023-07-16 06:12:18,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-16 06:12:18,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5da59321dfa76a73dddd89898830af38, ASSIGN in 340 msec 2023-07-16 06:12:18,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 24a40aa98b8feb4889cc331016085061, server=jenkins-hbase4.apache.org,34953,1689487858121 in 177 msec 2023-07-16 06:12:18,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-16 06:12:18,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=24a40aa98b8feb4889cc331016085061, ASSIGN in 342 msec 2023-07-16 06:12:18,465 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:12:18,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487938465"}]},"ts":"1689487938465"} 2023-07-16 06:12:18,466 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-16 06:12:18,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:12:18,471 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-16 06:12:18,472 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 06:12:18,474 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:18,474 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:18,474 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:18,474 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:18,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:18,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:18,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:18,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:18,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:18,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:18,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:18,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:18,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 485 msec 2023-07-16 06:12:18,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 06:12:18,606 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-16 06:12:18,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 5da59321dfa76a73dddd89898830af38, 24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5da59321dfa76a73dddd89898830af38, 24a40aa98b8feb4889cc331016085061], force=true 2023-07-16 06:12:18,670 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5da59321dfa76a73dddd89898830af38, 24a40aa98b8feb4889cc331016085061], force=true 2023-07-16 06:12:18,670 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5da59321dfa76a73dddd89898830af38, 24a40aa98b8feb4889cc331016085061], force=true 2023-07-16 06:12:18,670 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5da59321dfa76a73dddd89898830af38, 24a40aa98b8feb4889cc331016085061], force=true 2023-07-16 06:12:18,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:18,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5da59321dfa76a73dddd89898830af38, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=24a40aa98b8feb4889cc331016085061, UNASSIGN}] 2023-07-16 06:12:18,720 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5da59321dfa76a73dddd89898830af38, UNASSIGN 2023-07-16 06:12:18,721 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=24a40aa98b8feb4889cc331016085061, UNASSIGN 2023-07-16 06:12:18,723 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=24a40aa98b8feb4889cc331016085061, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:18,724 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487938723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487938723"}]},"ts":"1689487938723"} 2023-07-16 06:12:18,724 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5da59321dfa76a73dddd89898830af38, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:18,724 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487938724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487938724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487938724"}]},"ts":"1689487938724"} 2023-07-16 06:12:18,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 24a40aa98b8feb4889cc331016085061, server=jenkins-hbase4.apache.org,34953,1689487858121}] 2023-07-16 06:12:18,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 5da59321dfa76a73dddd89898830af38, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:18,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:18,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:18,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 24a40aa98b8feb4889cc331016085061, disabling compactions & flushes 2023-07-16 06:12:18,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. after waiting 0 ms 2023-07-16 06:12:18,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:18,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 24a40aa98b8feb4889cc331016085061 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 06:12:18,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:18,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5da59321dfa76a73dddd89898830af38, disabling compactions & flushes 2023-07-16 06:12:18,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. after waiting 0 ms 2023-07-16 06:12:18,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:18,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5da59321dfa76a73dddd89898830af38 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 06:12:18,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/.tmp/cf/d3a8717cbbfd4c938fa51b905f8c60d6 2023-07-16 06:12:18,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/.tmp/cf/ea212ad75de44b3a967ccecae68f7d77 2023-07-16 06:12:18,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/.tmp/cf/ea212ad75de44b3a967ccecae68f7d77 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf/ea212ad75de44b3a967ccecae68f7d77 2023-07-16 06:12:18,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/.tmp/cf/d3a8717cbbfd4c938fa51b905f8c60d6 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf/d3a8717cbbfd4c938fa51b905f8c60d6 2023-07-16 06:12:18,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf/ea212ad75de44b3a967ccecae68f7d77, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 06:12:18,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5da59321dfa76a73dddd89898830af38 in 83ms, sequenceid=5, compaction requested=false 2023-07-16 06:12:18,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 06:12:18,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf/d3a8717cbbfd4c938fa51b905f8c60d6, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 06:12:18,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:18,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 24a40aa98b8feb4889cc331016085061 in 100ms, sequenceid=5, compaction requested=false 2023-07-16 06:12:19,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 06:12:19,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:19,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38. 2023-07-16 06:12:19,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5da59321dfa76a73dddd89898830af38: 2023-07-16 06:12:19,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:19,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 06:12:19,038 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5da59321dfa76a73dddd89898830af38, regionState=CLOSED 2023-07-16 06:12:19,039 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487939038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487939038"}]},"ts":"1689487939038"} 2023-07-16 06:12:19,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:19,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061. 2023-07-16 06:12:19,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 24a40aa98b8feb4889cc331016085061: 2023-07-16 06:12:19,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:19,043 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=24a40aa98b8feb4889cc331016085061, regionState=CLOSED 2023-07-16 06:12:19,044 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689487939043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487939043"}]},"ts":"1689487939043"} 2023-07-16 06:12:19,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-16 06:12:19,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 5da59321dfa76a73dddd89898830af38, server=jenkins-hbase4.apache.org,41391,1689487858033 in 304 msec 2023-07-16 06:12:19,051 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5da59321dfa76a73dddd89898830af38, UNASSIGN in 338 msec 2023-07-16 06:12:19,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-16 06:12:19,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 24a40aa98b8feb4889cc331016085061, server=jenkins-hbase4.apache.org,34953,1689487858121 in 319 msec 2023-07-16 06:12:19,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-16 06:12:19,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=24a40aa98b8feb4889cc331016085061, UNASSIGN in 337 msec 2023-07-16 06:12:19,235 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-16 06:12:19,289 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937989.5da59321dfa76a73dddd89898830af38.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:19,289 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689487937989.24a40aa98b8feb4889cc331016085061.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:19,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:19,289 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:19,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=babcdc86a3bf97a65ddf4ceef668c670, ASSIGN}] 2023-07-16 06:12:19,391 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=babcdc86a3bf97a65ddf4ceef668c670, ASSIGN 2023-07-16 06:12:19,392 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=babcdc86a3bf97a65ddf4ceef668c670, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:12:19,542 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 06:12:19,544 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=babcdc86a3bf97a65ddf4ceef668c670, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:19,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689487939544"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487939544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487939544"}]},"ts":"1689487939544"} 2023-07-16 06:12:19,547 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure babcdc86a3bf97a65ddf4ceef668c670, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:19,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:19,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => babcdc86a3bf97a65ddf4ceef668c670, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.', STARTKEY => '', ENDKEY => ''} 2023-07-16 06:12:19,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. service=AccessControlService 2023-07-16 06:12:19,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:19,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:19,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:19,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:19,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:19,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/.regioninfo 2023-07-16 06:12:19,767 INFO [StoreOpener-babcdc86a3bf97a65ddf4ceef668c670-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:19,768 DEBUG [StoreOpener-babcdc86a3bf97a65ddf4ceef668c670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf 2023-07-16 06:12:19,768 DEBUG [StoreOpener-babcdc86a3bf97a65ddf4ceef668c670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf 2023-07-16 06:12:19,768 INFO [StoreOpener-babcdc86a3bf97a65ddf4ceef668c670-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region babcdc86a3bf97a65ddf4ceef668c670 columnFamilyName cf 2023-07-16 06:12:19,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:19,806 DEBUG [StoreOpener-babcdc86a3bf97a65ddf4ceef668c670-1] regionserver.HStore(539): loaded hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/d3a8717cbbfd4c938fa51b905f8c60d6.24a40aa98b8feb4889cc331016085061->hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf/d3a8717cbbfd4c938fa51b905f8c60d6-top 2023-07-16 06:12:19,816 DEBUG [StoreOpener-babcdc86a3bf97a65ddf4ceef668c670-1] regionserver.HStore(539): loaded hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/ea212ad75de44b3a967ccecae68f7d77.5da59321dfa76a73dddd89898830af38->hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf/ea212ad75de44b3a967ccecae68f7d77-top 2023-07-16 06:12:19,817 INFO [StoreOpener-babcdc86a3bf97a65ddf4ceef668c670-1] regionserver.HStore(310): Store=babcdc86a3bf97a65ddf4ceef668c670/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:19,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:19,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:19,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:19,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened babcdc86a3bf97a65ddf4ceef668c670; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71241955, jitterRate=0.061587855219841}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for babcdc86a3bf97a65ddf4ceef668c670: 2023-07-16 06:12:19,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670., pid=77, masterSystemTime=1689487939699 2023-07-16 06:12:19,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.,because compaction is disabled. 2023-07-16 06:12:19,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:19,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:19,861 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=babcdc86a3bf97a65ddf4ceef668c670, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:19,862 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689487939861"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487939861"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487939861"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487939861"}]},"ts":"1689487939861"} 2023-07-16 06:12:19,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-16 06:12:19,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure babcdc86a3bf97a65ddf4ceef668c670, server=jenkins-hbase4.apache.org,41391,1689487858033 in 316 msec 2023-07-16 06:12:19,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-16 06:12:19,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=babcdc86a3bf97a65ddf4ceef668c670, ASSIGN in 480 msec 2023-07-16 06:12:19,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5da59321dfa76a73dddd89898830af38, 24a40aa98b8feb4889cc331016085061], force=true in 1.2110 sec 2023-07-16 06:12:19,931 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0004_000001 (auth:SIMPLE) 2023-07-16 06:12:20,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 06:12:20,793 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-16 06:12:20,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 06:12:20,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487940794 (current time:1689487940794). 2023-07-16 06:12:20,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:20,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x5d141574 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:20,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53d3f0a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:20,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:20,819 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:20,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d141574 to 127.0.0.1:58206 2023-07-16 06:12:20,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:20,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x12eefa9d to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:20,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f2cf201, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:20,849 DEBUG [hconnection-0x23b66982-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:20,853 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:20,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12eefa9d to 127.0.0.1:58206 2023-07-16 06:12:20,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:20,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 06:12:20,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:20,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 06:12:20,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 06:12:20,865 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 06:12:20,866 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689488540866 2023-07-16 06:12:20,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 06:12:20,869 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:20,869 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:20,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 06:12:20,870 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 06:12:20,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-16 06:12:20,873 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 06:12:20,873 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689488540873 2023-07-16 06:12:20,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,884 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 06:12:20,884 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:20,886 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-16 06:12:20,886 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-16 06:12:20,886 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,886 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,888 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:20,888 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:20,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:20,888 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:20,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:20,888 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:20,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:20,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:20,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:20,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,888 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,889 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 06:12:20,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 06:12:20,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 06:12:20,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,890 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 06:12:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 06:12:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:20,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 06:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 06:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 06:12:20,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 06:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 06:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:20,893 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 06:12:20,894 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 06:12:20,894 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 06:12:20,894 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 06:12:20,894 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 06:12:20,894 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 06:12:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:20,901 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,901 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,901 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:20,915 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,915 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:20,916 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,916 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:20,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-16 06:12:20,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e6cbc9[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:20,918 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-16 06:12:20,918 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 06:12:20,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,923 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 06:12:20,923 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 06:12:20,923 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:20,923 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 06:12:20,923 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:20,923 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 06:12:20,923 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:12:20,924 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,924 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:20,923 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:20,924 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. started... 2023-07-16 06:12:20,924 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:12:20,927 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for babcdc86a3bf97a65ddf4ceef668c670: 2023-07-16 06:12:20,927 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,927 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:20,928 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/d3a8717cbbfd4c938fa51b905f8c60d6.24a40aa98b8feb4889cc331016085061->hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf/d3a8717cbbfd4c938fa51b905f8c60d6-top, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/ea212ad75de44b3a967ccecae68f7d77.5da59321dfa76a73dddd89898830af38->hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf/ea212ad75de44b3a967ccecae68f7d77-top] hfiles 2023-07-16 06:12:20,928 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/d3a8717cbbfd4c938fa51b905f8c60d6.24a40aa98b8feb4889cc331016085061 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,928 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/ea212ad75de44b3a967ccecae68f7d77.5da59321dfa76a73dddd89898830af38 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 06:12:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 06:12:20,938 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 06:12:20,938 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:20,938 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 06:12:20,943 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. completed. 2023-07-16 06:12:20,943 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:20,943 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:20,943 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:20,943 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,943 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 06:12:20,943 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:12:20,956 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 06:12:20,957 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 06:12:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:12:20,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-16 06:12:20,961 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-16 06:12:20,961 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:20,961 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:20,961 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,961 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:20,963 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,963 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,963 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,963 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:20,963 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:20,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,964 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,963 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:20,967 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,967 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:20,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,968 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,969 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,970 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 06:12:20,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:20,971 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,971 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,971 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,974 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,974 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,974 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,974 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:20,975 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,975 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:20,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,975 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:20,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:20,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:20,979 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:20,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:20,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:20,979 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:20,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:20,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:20,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:21,007 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:12:21,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-16 06:12:21,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:21,095 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:21,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689487940866Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689487940975 (+109 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689487940975Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689487940980 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689487940991 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689487941093 (+102 ms) 2023-07-16 06:12:21,103 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 06:12:21,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 234 msec 2023-07-16 06:12:21,171 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:21,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 06:12:21,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:21,175 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175 2023-07-16 06:12:21,175 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37171, tgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175, rawTgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175, srcFsUri=hdfs://localhost:37171, srcDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:12:21,220 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:12:21,220 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-60960084_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:21,220 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2, snapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-16 06:12:21,233 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:21,307 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,311 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,312 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,312 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,313 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,313 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,313 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,400 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop-622329592458473854.jar 2023-07-16 06:12:21,401 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,402 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,402 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,403 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,403 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,403 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:21,404 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:12:21,404 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:12:21,405 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:12:21,405 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:12:21,406 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:12:21,406 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:12:21,407 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:12:21,407 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:12:21,407 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:12:21,408 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:12:21,408 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:21,408 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:21,409 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:21,409 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:21,409 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:21,410 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:21,410 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:21,818 WARN [Listener at jenkins-hbase4.apache.org/41271] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:12:21,820 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-16 06:12:21,822 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-16 06:12:21,880 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:21,880 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:21,938 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:28,059 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:30,293 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:35,075 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:37,095 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:12:37,115 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:12:37,150 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,151 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:12:37,151 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:12:37,152 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,152 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 06:12:37,152 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 06:12:37,153 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,154 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 06:12:37,154 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487941175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 06:12:37,167 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,167 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,177 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487957177"}]},"ts":"1689487957177"} 2023-07-16 06:12:37,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 06:12:37,178 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-16 06:12:37,180 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-16 06:12:37,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=babcdc86a3bf97a65ddf4ceef668c670, UNASSIGN}] 2023-07-16 06:12:37,183 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=babcdc86a3bf97a65ddf4ceef668c670, UNASSIGN 2023-07-16 06:12:37,184 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=babcdc86a3bf97a65ddf4ceef668c670, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:37,184 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689487957184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487957184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487957184"}]},"ts":"1689487957184"} 2023-07-16 06:12:37,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure babcdc86a3bf97a65ddf4ceef668c670, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:37,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 06:12:37,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:37,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing babcdc86a3bf97a65ddf4ceef668c670, disabling compactions & flushes 2023-07-16 06:12:37,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:37,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:37,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. after waiting 0 ms 2023-07-16 06:12:37,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:37,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-16 06:12:37,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:37,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670. 2023-07-16 06:12:37,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for babcdc86a3bf97a65ddf4ceef668c670: 2023-07-16 06:12:37,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:37,356 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=babcdc86a3bf97a65ddf4ceef668c670, regionState=CLOSED 2023-07-16 06:12:37,357 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689487957356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487957356"}]},"ts":"1689487957356"} 2023-07-16 06:12:37,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-16 06:12:37,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure babcdc86a3bf97a65ddf4ceef668c670, server=jenkins-hbase4.apache.org,41391,1689487858033 in 173 msec 2023-07-16 06:12:37,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-16 06:12:37,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=babcdc86a3bf97a65ddf4ceef668c670, UNASSIGN in 179 msec 2023-07-16 06:12:37,362 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487957362"}]},"ts":"1689487957362"} 2023-07-16 06:12:37,365 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-16 06:12:37,366 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-16 06:12:37,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 200 msec 2023-07-16 06:12:37,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 06:12:37,481 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-16 06:12:37,481 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,486 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,487 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,491 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:37,491 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:37,491 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:37,491 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,491 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,491 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,491 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 06:12:37,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 06:12:37,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 06:12:37,494 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,494 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,494 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,494 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 06:12:37,494 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,494 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,494 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,494 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:12:37,494 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:37,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 06:12:37,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:37,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:37,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:37,496 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/recovered.edits] 2023-07-16 06:12:37,496 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/recovered.edits] 2023-07-16 06:12:37,497 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/recovered.edits] 2023-07-16 06:12:37,505 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf/d3a8717cbbfd4c938fa51b905f8c60d6 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/cf/d3a8717cbbfd4c938fa51b905f8c60d6 2023-07-16 06:12:37,508 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf/ea212ad75de44b3a967ccecae68f7d77 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/cf/ea212ad75de44b3a967ccecae68f7d77 2023-07-16 06:12:37,509 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/d3a8717cbbfd4c938fa51b905f8c60d6.24a40aa98b8feb4889cc331016085061 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/d3a8717cbbfd4c938fa51b905f8c60d6.24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:37,511 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/recovered.edits/8.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061/recovered.edits/8.seqid 2023-07-16 06:12:37,512 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/ea212ad75de44b3a967ccecae68f7d77.5da59321dfa76a73dddd89898830af38 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/cf/ea212ad75de44b3a967ccecae68f7d77.5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:37,513 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/24a40aa98b8feb4889cc331016085061 2023-07-16 06:12:37,516 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/recovered.edits/8.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38/recovered.edits/8.seqid 2023-07-16 06:12:37,517 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5da59321dfa76a73dddd89898830af38 2023-07-16 06:12:37,518 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/recovered.edits/12.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670/recovered.edits/12.seqid 2023-07-16 06:12:37,518 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/babcdc86a3bf97a65ddf4ceef668c670 2023-07-16 06:12:37,518 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 06:12:37,527 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,533 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-16 06:12:37,535 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-16 06:12:37,536 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,536 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-16 06:12:37,536 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487957536"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,538 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-16 06:12:37,538 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => babcdc86a3bf97a65ddf4ceef668c670, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689487937990.babcdc86a3bf97a65ddf4ceef668c670.', STARTKEY => '', ENDKEY => ''}] 2023-07-16 06:12:37,538 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-16 06:12:37,538 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487957538"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,545 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-16 06:12:37,548 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:37,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 66 msec 2023-07-16 06:12:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 06:12:37,598 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-16 06:12:37,598 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 06:12:37,607 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487957607"}]},"ts":"1689487957607"} 2023-07-16 06:12:37,609 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-16 06:12:37,611 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-16 06:12:37,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e12afd8e285ecb186a206ca46491904d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2395e777d8c360dfd11567f781a08b83, UNASSIGN}] 2023-07-16 06:12:37,613 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2395e777d8c360dfd11567f781a08b83, UNASSIGN 2023-07-16 06:12:37,617 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e12afd8e285ecb186a206ca46491904d, UNASSIGN 2023-07-16 06:12:37,618 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2395e777d8c360dfd11567f781a08b83, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:37,618 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487957618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487957618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487957618"}]},"ts":"1689487957618"} 2023-07-16 06:12:37,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e12afd8e285ecb186a206ca46491904d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:37,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487957618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487957618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487957618"}]},"ts":"1689487957618"} 2023-07-16 06:12:37,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure e12afd8e285ecb186a206ca46491904d, server=jenkins-hbase4.apache.org,34953,1689487858121}] 2023-07-16 06:12:37,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 2395e777d8c360dfd11567f781a08b83, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:37,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 06:12:37,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:37,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e12afd8e285ecb186a206ca46491904d, disabling compactions & flushes 2023-07-16 06:12:37,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:37,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:37,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. after waiting 0 ms 2023-07-16 06:12:37,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:37,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:37,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2395e777d8c360dfd11567f781a08b83, disabling compactions & flushes 2023-07-16 06:12:37,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:37,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:37,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. after waiting 0 ms 2023-07-16 06:12:37,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:37,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:37,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:37,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d. 2023-07-16 06:12:37,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e12afd8e285ecb186a206ca46491904d: 2023-07-16 06:12:37,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:37,797 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e12afd8e285ecb186a206ca46491904d, regionState=CLOSED 2023-07-16 06:12:37,798 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487957797"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487957797"}]},"ts":"1689487957797"} 2023-07-16 06:12:37,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:37,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:37,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83. 2023-07-16 06:12:37,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2395e777d8c360dfd11567f781a08b83: 2023-07-16 06:12:37,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:37,802 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2395e777d8c360dfd11567f781a08b83, regionState=CLOSED 2023-07-16 06:12:37,802 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689487957802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487957802"}]},"ts":"1689487957802"} 2023-07-16 06:12:37,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-16 06:12:37,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure e12afd8e285ecb186a206ca46491904d, server=jenkins-hbase4.apache.org,34953,1689487858121 in 180 msec 2023-07-16 06:12:37,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e12afd8e285ecb186a206ca46491904d, UNASSIGN in 191 msec 2023-07-16 06:12:37,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-16 06:12:37,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 2395e777d8c360dfd11567f781a08b83, server=jenkins-hbase4.apache.org,41391,1689487858033 in 174 msec 2023-07-16 06:12:37,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-16 06:12:37,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2395e777d8c360dfd11567f781a08b83, UNASSIGN in 194 msec 2023-07-16 06:12:37,808 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487957808"}]},"ts":"1689487957808"} 2023-07-16 06:12:37,809 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-16 06:12:37,812 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-16 06:12:37,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 215 msec 2023-07-16 06:12:37,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 06:12:37,912 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-16 06:12:37,913 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,917 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,918 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,919 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,922 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,922 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,922 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,922 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 06:12:37,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 06:12:37,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 06:12:37,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 06:12:37,924 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,924 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,924 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,924 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,924 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,925 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,925 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,925 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:37,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 06:12:37,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:37,927 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:37,929 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/recovered.edits] 2023-07-16 06:12:37,929 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/recovered.edits] 2023-07-16 06:12:37,934 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf/0243b399b9e4446d8d10c49cf87d42a8 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/cf/0243b399b9e4446d8d10c49cf87d42a8 2023-07-16 06:12:37,935 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf/6d14f2dbd18744d5825ee96426109148 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/cf/6d14f2dbd18744d5825ee96426109148 2023-07-16 06:12:37,939 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d/recovered.edits/9.seqid 2023-07-16 06:12:37,940 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e12afd8e285ecb186a206ca46491904d 2023-07-16 06:12:37,940 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83/recovered.edits/9.seqid 2023-07-16 06:12:37,940 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2395e777d8c360dfd11567f781a08b83 2023-07-16 06:12:37,941 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 06:12:37,941 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-16 06:12:37,942 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-16 06:12:37,945 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307160343753c30b64940ac99545ad201ca0e to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307160343753c30b64940ac99545ad201ca0e 2023-07-16 06:12:37,947 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307169c046496e6b9498495f2bed0a975b592 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307169c046496e6b9498495f2bed0a975b592 2023-07-16 06:12:37,947 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-16 06:12:37,950 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,952 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-16 06:12:37,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-16 06:12:37,955 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,956 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-16 06:12:37,956 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487957956"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,956 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487957956"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,958 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:12:37,958 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e12afd8e285ecb186a206ca46491904d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689487935759.e12afd8e285ecb186a206ca46491904d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2395e777d8c360dfd11567f781a08b83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689487935759.2395e777d8c360dfd11567f781a08b83.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:12:37,958 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-16 06:12:37,958 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487957958"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:37,959 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-16 06:12:37,963 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:37,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 50 msec 2023-07-16 06:12:38,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 06:12:38,028 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-16 06:12:38,043 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 06:12:38,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:38,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 06:12:38,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 06:12:38,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-16 06:12:38,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 06:12:38,104 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 747) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:34345 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1049079203_1 at /127.0.0.1:35136 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:35580 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4103 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:37228 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1049079203_1 at /127.0.0.1:35550 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:35156 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=557 (was 446) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=2690 (was 3095) 2023-07-16 06:12:38,104 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-16 06:12:38,160 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=557, ProcessCount=183, AvailableMemoryMB=2682 2023-07-16 06:12:38,161 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-16 06:12:38,163 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 06:12:38,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:38,174 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:12:38,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-16 06:12:38,175 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:12:38,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:38,177 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42 2023-07-16 06:12:38,177 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:38,178 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42 empty. 2023-07-16 06:12:38,179 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98 empty. 2023-07-16 06:12:38,179 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42 2023-07-16 06:12:38,179 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:38,180 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 06:12:38,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:38,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:38,613 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 06:12:38,619 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 18181707200185b73d9946ae33f7da42, NAME => 'testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:12:38,619 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fb921a1f4d72d096113275d68802ce98, NAME => 'testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:12:38,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:38,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:38,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 18181707200185b73d9946ae33f7da42, disabling compactions & flushes 2023-07-16 06:12:38,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fb921a1f4d72d096113275d68802ce98, disabling compactions & flushes 2023-07-16 06:12:38,686 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:38,686 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:38,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:38,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:38,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. after waiting 0 ms 2023-07-16 06:12:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. after waiting 0 ms 2023-07-16 06:12:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:38,687 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fb921a1f4d72d096113275d68802ce98: 2023-07-16 06:12:38,687 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 18181707200185b73d9946ae33f7da42: 2023-07-16 06:12:38,692 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:12:38,693 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487958693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487958693"}]},"ts":"1689487958693"} 2023-07-16 06:12:38,693 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487958693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487958693"}]},"ts":"1689487958693"} 2023-07-16 06:12:38,696 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:12:38,697 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:12:38,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487958697"}]},"ts":"1689487958697"} 2023-07-16 06:12:38,700 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 06:12:38,705 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:12:38,706 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:12:38,706 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:12:38,707 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:12:38,707 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:12:38,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18181707200185b73d9946ae33f7da42, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fb921a1f4d72d096113275d68802ce98, ASSIGN}] 2023-07-16 06:12:38,709 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fb921a1f4d72d096113275d68802ce98, ASSIGN 2023-07-16 06:12:38,710 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18181707200185b73d9946ae33f7da42, ASSIGN 2023-07-16 06:12:38,711 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18181707200185b73d9946ae33f7da42, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:12:38,711 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fb921a1f4d72d096113275d68802ce98, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35311,1689487858185; forceNewPlan=false, retain=false 2023-07-16 06:12:38,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:38,861 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:12:38,864 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fb921a1f4d72d096113275d68802ce98, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:38,864 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=18181707200185b73d9946ae33f7da42, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:38,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487958864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487958864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487958864"}]},"ts":"1689487958864"} 2023-07-16 06:12:38,865 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487958864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487958864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487958864"}]},"ts":"1689487958864"} 2023-07-16 06:12:38,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure fb921a1f4d72d096113275d68802ce98, server=jenkins-hbase4.apache.org,35311,1689487858185}] 2023-07-16 06:12:38,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 18181707200185b73d9946ae33f7da42, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:39,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:39,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18181707200185b73d9946ae33f7da42, NAME => 'testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:12:39,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. service=AccessControlService 2023-07-16 06:12:39,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:39,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 18181707200185b73d9946ae33f7da42 2023-07-16 06:12:39,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:39,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18181707200185b73d9946ae33f7da42 2023-07-16 06:12:39,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18181707200185b73d9946ae33f7da42 2023-07-16 06:12:39,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:39,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb921a1f4d72d096113275d68802ce98, NAME => 'testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:12:39,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. service=AccessControlService 2023-07-16 06:12:39,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:39,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:39,039 INFO [StoreOpener-18181707200185b73d9946ae33f7da42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18181707200185b73d9946ae33f7da42 2023-07-16 06:12:39,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:39,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:39,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:39,040 DEBUG [StoreOpener-18181707200185b73d9946ae33f7da42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf 2023-07-16 06:12:39,040 INFO [StoreOpener-fb921a1f4d72d096113275d68802ce98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:39,040 DEBUG [StoreOpener-18181707200185b73d9946ae33f7da42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf 2023-07-16 06:12:39,041 INFO [StoreOpener-18181707200185b73d9946ae33f7da42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18181707200185b73d9946ae33f7da42 columnFamilyName cf 2023-07-16 06:12:39,042 DEBUG [StoreOpener-fb921a1f4d72d096113275d68802ce98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf 2023-07-16 06:12:39,042 DEBUG [StoreOpener-fb921a1f4d72d096113275d68802ce98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf 2023-07-16 06:12:39,042 INFO [StoreOpener-fb921a1f4d72d096113275d68802ce98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb921a1f4d72d096113275d68802ce98 columnFamilyName cf 2023-07-16 06:12:39,042 INFO [StoreOpener-18181707200185b73d9946ae33f7da42-1] regionserver.HStore(310): Store=18181707200185b73d9946ae33f7da42/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:39,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42 2023-07-16 06:12:39,043 INFO [StoreOpener-fb921a1f4d72d096113275d68802ce98-1] regionserver.HStore(310): Store=fb921a1f4d72d096113275d68802ce98/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:39,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42 2023-07-16 06:12:39,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:39,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:39,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:39,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:39,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb921a1f4d72d096113275d68802ce98; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75036736, jitterRate=0.1181344985961914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:39,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb921a1f4d72d096113275d68802ce98: 2023-07-16 06:12:39,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98., pid=93, masterSystemTime=1689487959024 2023-07-16 06:12:39,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18181707200185b73d9946ae33f7da42 2023-07-16 06:12:39,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:39,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:39,057 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fb921a1f4d72d096113275d68802ce98, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,057 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487959057"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487959057"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487959057"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487959057"}]},"ts":"1689487959057"} 2023-07-16 06:12:39,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:39,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18181707200185b73d9946ae33f7da42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63572149, jitterRate=-0.052701160311698914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:39,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18181707200185b73d9946ae33f7da42: 2023-07-16 06:12:39,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42., pid=94, masterSystemTime=1689487959024 2023-07-16 06:12:39,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:39,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:39,062 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=18181707200185b73d9946ae33f7da42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,062 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487959062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487959062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487959062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487959062"}]},"ts":"1689487959062"} 2023-07-16 06:12:39,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-16 06:12:39,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure fb921a1f4d72d096113275d68802ce98, server=jenkins-hbase4.apache.org,35311,1689487858185 in 191 msec 2023-07-16 06:12:39,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-16 06:12:39,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fb921a1f4d72d096113275d68802ce98, ASSIGN in 360 msec 2023-07-16 06:12:39,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 18181707200185b73d9946ae33f7da42, server=jenkins-hbase4.apache.org,41391,1689487858033 in 196 msec 2023-07-16 06:12:39,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-16 06:12:39,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18181707200185b73d9946ae33f7da42, ASSIGN in 368 msec 2023-07-16 06:12:39,081 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:12:39,082 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487959081"}]},"ts":"1689487959081"} 2023-07-16 06:12:39,083 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 06:12:39,087 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:12:39,087 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-16 06:12:39,089 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:12:39,091 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:39,091 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:39,091 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:39,091 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:39,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:39,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:39,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:39,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:39,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 930 msec 2023-07-16 06:12:39,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 06:12:39,282 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-16 06:12:39,285 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:39,286 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:39,288 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:39,318 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:39,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487959318 (current time:1689487959318). 2023-07-16 06:12:39,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:39,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x364e5806 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:39,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@560937b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:39,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:39,336 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:39,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x364e5806 to 127.0.0.1:58206 2023-07-16 06:12:39,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:39,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x16e785a2 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:39,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@522d6110, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:39,347 DEBUG [hconnection-0x4d86281a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:39,348 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:39,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16e785a2 to 127.0.0.1:58206 2023-07-16 06:12:39,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:39,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:12:39,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:39,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:39,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:39,359 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:39,360 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689488559360 2023-07-16 06:12:39,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:39,361 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:39,361 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:39,362 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:39,363 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:39,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:39,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-16 06:12:39,368 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:39,375 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689488559375 2023-07-16 06:12:39,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,400 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-16 06:12:39,400 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:39,402 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 06:12:39,402 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 06:12:39,403 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,403 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,408 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:39,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 06:12:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,410 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:39,411 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:39,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:39,411 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:39,411 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,411 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,412 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:39,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:39,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:39,412 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,412 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:39,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 06:12:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,413 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:39,413 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 06:12:39,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:39,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:39,416 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:39,417 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:39,417 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:39,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,419 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:39,419 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:39,420 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:39,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:39,420 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:39,429 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,429 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:39,428 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:39,434 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:39,429 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:39,434 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:39,434 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:39,437 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:39,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,439 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,439 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,441 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:39,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:39,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:39,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 06:12:39,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b295865[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:39,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:39,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:39,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 06:12:39,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b295865[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:39,446 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 06:12:39,446 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:39,449 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,449 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:39,449 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,449 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:39,449 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:39,449 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:12:39,450 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,450 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:39,451 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:39,451 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:39,451 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:39,454 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:39,456 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:39,456 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:39,456 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:39,457 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:39,457 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. started... 2023-07-16 06:12:39,457 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:39,457 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. started... 2023-07-16 06:12:39,457 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18181707200185b73d9946ae33f7da42: 2023-07-16 06:12:39,458 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb921a1f4d72d096113275d68802ce98: 2023-07-16 06:12:39,459 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,459 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:39,459 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,459 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:39,459 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:39,459 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:39,462 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:39,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:39,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:39,463 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:39,495 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. completed. 2023-07-16 06:12:39,496 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:12:39,498 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,498 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:39,498 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:39,498 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:39,502 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. completed. 2023-07-16 06:12:39,502 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:12:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,504 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:39,504 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:39,504 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,504 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:39,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:12:39,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 06:12:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:39,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:39,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:39,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35311,1689487858185': 2023-07-16 06:12:39,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 06:12:39,516 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 06:12:39,516 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:39,516 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:39,516 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,516 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:39,520 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,520 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,520 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:39,520 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:39,520 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,520 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,520 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:39,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:39,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:39,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:39,521 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,522 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,523 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:39,525 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,525 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,526 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,531 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,531 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:39,531 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,532 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:39,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,534 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:39,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:39,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:12:39,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:39,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:39,535 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:39,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:39,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:39,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:39,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:39,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 06:12:39,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:39,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:39,543 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:39,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:39,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:39,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:39,664 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:39,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:39,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:39,666 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:39,966 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:39,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:39,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:39,968 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 06:12:40,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 06:12:40,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,120 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689487959361Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689487959603 (+242 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689487959603Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689487959603Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689487959608 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689487959634 (+26 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689487960120 (+486 ms) 2023-07-16 06:12:40,125 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:40,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 763 msec 2023-07-16 06:12:40,468 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:40,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35311] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:40,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41391] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:40,476 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:40,476 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:40,476 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:40,493 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:40,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487960493 (current time:1689487960493). 2023-07-16 06:12:40,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:40,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x74fbcebd to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:40,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@841fec0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:40,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:40,547 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:40,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74fbcebd to 127.0.0.1:58206 2023-07-16 06:12:40,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:40,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x20176047 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:40,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a33ccde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:40,583 DEBUG [hconnection-0xd8394a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:40,591 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:40,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20176047 to 127.0.0.1:58206 2023-07-16 06:12:40,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:40,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 06:12:40,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:40,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:40,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:40,615 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:40,616 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689488560616 2023-07-16 06:12:40,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 06:12:40,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:40,617 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:40,619 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:40,620 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 06:12:40,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:40,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-16 06:12:40,623 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:40,624 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689488560624 2023-07-16 06:12:40,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,651 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-16 06:12:40,651 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:40,653 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 06:12:40,653 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 06:12:40,710 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,710 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,711 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:40,711 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:40,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:40,712 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:40,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:40,712 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:40,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,712 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:40,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,712 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:40,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 06:12:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:40,713 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:40,713 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:40,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,714 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:40,714 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:40,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 06:12:40,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 06:12:40,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,714 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:40,714 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 06:12:40,716 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:40,716 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:40,716 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:40,718 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:40,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:40,719 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:40,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:40,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:40,720 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:40,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 06:12:40,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@509108fa[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:40,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,723 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:40,723 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:40,732 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:40,732 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,732 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:40,732 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 06:12:40,732 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:40,732 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 06:12:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 06:12:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 06:12:40,749 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,750 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,750 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:40,755 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:40,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:40,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:40,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:40,755 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,756 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,756 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:40,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:40,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:40,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:40,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:40,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:40,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 06:12:40,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@509108fa[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:40,759 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 06:12:40,759 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,764 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,764 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,764 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:40,765 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:40,765 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,765 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. started... 2023-07-16 06:12:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:12:40,765 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:40,765 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:40,765 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18181707200185b73d9946ae33f7da42 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 06:12:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 06:12:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:40,773 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:40,792 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:40,792 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. started... 2023-07-16 06:12:40,793 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fb921a1f4d72d096113275d68802ce98 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 06:12:40,866 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716cb491c20be3c4786afdb8015987b2654 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716cb491c20be3c4786afdb8015987b2654 2023-07-16 06:12:40,883 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716af24d84a24e8419a9b8b9d598b25afd5 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716af24d84a24e8419a9b8b9d598b25afd5 2023-07-16 06:12:40,921 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:40,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:40,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:40,922 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:40,952 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/.tmp/cf/acfe7b80ca8248a1af2b3022eca753e8 2023-07-16 06:12:40,957 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/.tmp/cf/76496505dc79411c9d1aa9cff7392288 2023-07-16 06:12:40,964 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/.tmp/cf/76496505dc79411c9d1aa9cff7392288 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf/76496505dc79411c9d1aa9cff7392288 2023-07-16 06:12:40,967 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/.tmp/cf/acfe7b80ca8248a1af2b3022eca753e8 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf/acfe7b80ca8248a1af2b3022eca753e8 2023-07-16 06:12:40,972 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf/76496505dc79411c9d1aa9cff7392288, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 06:12:40,973 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 18181707200185b73d9946ae33f7da42 in 208ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:40,973 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-16 06:12:40,974 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18181707200185b73d9946ae33f7da42: 2023-07-16 06:12:40,974 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,974 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:40,974 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf/76496505dc79411c9d1aa9cff7392288] hfiles 2023-07-16 06:12:40,974 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf/76496505dc79411c9d1aa9cff7392288 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,975 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf/acfe7b80ca8248a1af2b3022eca753e8, entries=47, sequenceid=6, filesize=13.1 K 2023-07-16 06:12:40,976 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for fb921a1f4d72d096113275d68802ce98 in 183ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:40,978 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb921a1f4d72d096113275d68802ce98: 2023-07-16 06:12:40,979 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:40,981 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:40,981 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf/acfe7b80ca8248a1af2b3022eca753e8] hfiles 2023-07-16 06:12:40,981 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf/acfe7b80ca8248a1af2b3022eca753e8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,026 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. completed. 2023-07-16 06:12:41,026 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:41,026 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:41,026 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:41,026 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,026 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:41,026 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:12:41,028 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:41,029 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:41,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:41,029 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:41,029 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:41,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:12:41,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 06:12:41,223 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:41,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:41,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:41,225 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 06:12:41,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0005_000001 (auth:SIMPLE) 2023-07-16 06:12:41,414 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. completed. 2023-07-16 06:12:41,414 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:41,414 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:41,415 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:41,415 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,415 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 06:12:41,415 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:12:41,519 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,519 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 06:12:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:41,519 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:41,519 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 06:12:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35311,1689487858185': 2023-07-16 06:12:41,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 06:12:41,527 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 06:12:41,527 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:41,527 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:41,527 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,527 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:41,604 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:41,604 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:41,604 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,604 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,605 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:41,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:41,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:41,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:41,605 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:41,606 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,609 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,609 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:41,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,611 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,650 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:41,651 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:41,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:41,651 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:41,651 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:41,651 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:41,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:41,652 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:41,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,653 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:41,654 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:41,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:41,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716af24d84a24e8419a9b8b9d598b25afd5, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716cb491c20be3c4786afdb8015987b2654] mob files 2023-07-16 06:12:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:41,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:41,656 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:41,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716af24d84a24e8419a9b8b9d598b25afd5 2023-07-16 06:12:41,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716cb491c20be3c4786afdb8015987b2654 2023-07-16 06:12:41,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:41,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,725 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:41,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:41,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:41,726 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-16 06:12:41,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 06:12:41,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,824 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:41,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689487960617Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689487961716 (+1099 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689487961716Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689487961717 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689487961721 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689487961755 (+34 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689487961822 (+67 ms) 2023-07-16 06:12:41,829 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 06:12:41,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.2100 sec 2023-07-16 06:12:42,726 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:42,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 06:12:42,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:42,727 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727 2023-07-16 06:12:42,728 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37171, tgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727, rawTgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727, srcFsUri=hdfs://localhost:37171, srcDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:12:42,750 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:12:42,751 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-765695956_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:42,751 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2, snapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-16 06:12:42,757 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:42,961 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:12:43,202 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,202 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,203 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,203 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,203 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,203 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,204 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,299 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop-5369819122284399908.jar 2023-07-16 06:12:43,300 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,300 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,301 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,301 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,302 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,302 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:43,303 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:12:43,303 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:12:43,304 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:12:43,304 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:12:43,305 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:12:43,306 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:12:43,306 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:12:43,307 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:12:43,307 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:12:43,308 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:12:43,308 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:43,309 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:43,309 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:43,310 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:43,310 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:43,311 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:43,311 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:45,220 WARN [Listener at jenkins-hbase4.apache.org/41271] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:12:45,223 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-16 06:12:45,328 WARN [DataStreamer for file /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689487866190_0006/job.splitmetainfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-16 06:12:45,472 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:45,474 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:46,055 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0006_000001 (auth:SIMPLE) 2023-07-16 06:12:51,920 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0006_000001 (auth:SIMPLE) 2023-07-16 06:12:54,611 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:12:54,612 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:12:54,630 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:54,630 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:12:54,631 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:12:54,631 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:54,632 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 06:12:54,632 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 06:12:54,632 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:54,633 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 06:12:54,633 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487962727/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 06:12:54,642 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,643 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 06:12:54,653 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487974653"}]},"ts":"1689487974653"} 2023-07-16 06:12:54,655 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 06:12:54,656 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-16 06:12:54,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18181707200185b73d9946ae33f7da42, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fb921a1f4d72d096113275d68802ce98, UNASSIGN}] 2023-07-16 06:12:54,659 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fb921a1f4d72d096113275d68802ce98, UNASSIGN 2023-07-16 06:12:54,665 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18181707200185b73d9946ae33f7da42, UNASSIGN 2023-07-16 06:12:54,665 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fb921a1f4d72d096113275d68802ce98, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:54,665 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487974665"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487974665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487974665"}]},"ts":"1689487974665"} 2023-07-16 06:12:54,667 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=18181707200185b73d9946ae33f7da42, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:54,667 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487974666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487974666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487974666"}]},"ts":"1689487974666"} 2023-07-16 06:12:54,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure fb921a1f4d72d096113275d68802ce98, server=jenkins-hbase4.apache.org,35311,1689487858185}] 2023-07-16 06:12:54,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 18181707200185b73d9946ae33f7da42, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:54,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 06:12:54,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18181707200185b73d9946ae33f7da42 2023-07-16 06:12:54,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:54,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18181707200185b73d9946ae33f7da42, disabling compactions & flushes 2023-07-16 06:12:54,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb921a1f4d72d096113275d68802ce98, disabling compactions & flushes 2023-07-16 06:12:54,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:54,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:54,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:54,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:54,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. after waiting 0 ms 2023-07-16 06:12:54,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. after waiting 0 ms 2023-07-16 06:12:54,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:54,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:54,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:54,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:54,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42. 2023-07-16 06:12:54,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18181707200185b73d9946ae33f7da42: 2023-07-16 06:12:54,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18181707200185b73d9946ae33f7da42 2023-07-16 06:12:54,845 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=18181707200185b73d9946ae33f7da42, regionState=CLOSED 2023-07-16 06:12:54,845 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487974845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487974845"}]},"ts":"1689487974845"} 2023-07-16 06:12:54,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-16 06:12:54,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 18181707200185b73d9946ae33f7da42, server=jenkins-hbase4.apache.org,41391,1689487858033 in 178 msec 2023-07-16 06:12:54,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18181707200185b73d9946ae33f7da42, UNASSIGN in 192 msec 2023-07-16 06:12:54,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:12:54,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:12:54,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98. 2023-07-16 06:12:54,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb921a1f4d72d096113275d68802ce98: 2023-07-16 06:12:54,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:54,857 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fb921a1f4d72d096113275d68802ce98, regionState=CLOSED 2023-07-16 06:12:54,857 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689487974857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487974857"}]},"ts":"1689487974857"} 2023-07-16 06:12:54,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-16 06:12:54,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure fb921a1f4d72d096113275d68802ce98, server=jenkins-hbase4.apache.org,35311,1689487858185 in 191 msec 2023-07-16 06:12:54,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-16 06:12:54,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fb921a1f4d72d096113275d68802ce98, UNASSIGN in 203 msec 2023-07-16 06:12:54,863 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487974863"}]},"ts":"1689487974863"} 2023-07-16 06:12:54,864 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 06:12:54,866 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-16 06:12:54,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 223 msec 2023-07-16 06:12:54,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 06:12:54,956 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-16 06:12:54,957 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,961 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,962 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,963 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,966 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:54,966 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42 2023-07-16 06:12:54,967 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,967 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,967 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,968 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 06:12:54,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 06:12:54,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 06:12:54,968 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,969 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:54,969 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,969 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,969 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:54,969 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:54,969 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:54,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-16 06:12:54,969 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 06:12:54,969 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/recovered.edits] 2023-07-16 06:12:54,969 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/recovered.edits] 2023-07-16 06:12:54,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 06:12:54,975 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf/acfe7b80ca8248a1af2b3022eca753e8 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/cf/acfe7b80ca8248a1af2b3022eca753e8 2023-07-16 06:12:54,976 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf/76496505dc79411c9d1aa9cff7392288 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/cf/76496505dc79411c9d1aa9cff7392288 2023-07-16 06:12:54,979 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98/recovered.edits/9.seqid 2023-07-16 06:12:54,980 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/fb921a1f4d72d096113275d68802ce98 2023-07-16 06:12:54,980 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42/recovered.edits/9.seqid 2023-07-16 06:12:54,980 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testEmptyExportFileSystemState/18181707200185b73d9946ae33f7da42 2023-07-16 06:12:54,980 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 06:12:54,981 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-16 06:12:54,982 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-16 06:12:54,985 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716af24d84a24e8419a9b8b9d598b25afd5 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716af24d84a24e8419a9b8b9d598b25afd5 2023-07-16 06:12:54,986 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716cb491c20be3c4786afdb8015987b2654 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716cb491c20be3c4786afdb8015987b2654 2023-07-16 06:12:54,987 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-16 06:12:54,989 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,991 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-16 06:12:54,994 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-16 06:12:54,994 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:54,995 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-16 06:12:54,995 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487974995"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:54,995 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487974995"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:54,997 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:12:54,997 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 18181707200185b73d9946ae33f7da42, NAME => 'testtb-testEmptyExportFileSystemState,,1689487958162.18181707200185b73d9946ae33f7da42.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fb921a1f4d72d096113275d68802ce98, NAME => 'testtb-testEmptyExportFileSystemState,1,1689487958162.fb921a1f4d72d096113275d68802ce98.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:12:54,997 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-16 06:12:54,997 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487974997"}]},"ts":"9223372036854775807"} 2023-07-16 06:12:54,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-16 06:12:55,000 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 06:12:55,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 43 msec 2023-07-16 06:12:55,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 06:12:55,072 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-16 06:12:55,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-16 06:12:55,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:55,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-16 06:12:55,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-16 06:12:55,117 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-787855563_1 at /127.0.0.1:45948 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4907 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:49340 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_499812108_17 at /127.0.0.1:58494 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-787855563_1 at /127.0.0.1:32986 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-771076800_17 at /127.0.0.1:32998 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:43055 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:44799 from appattempt_1689487866190_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x65d1f25d-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=609 (was 557) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 183), AvailableMemoryMB=1915 (was 2682) 2023-07-16 06:12:55,117 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-16 06:12:55,140 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=609, ProcessCount=179, AvailableMemoryMB=1912 2023-07-16 06:12:55,140 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-16 06:12:55,141 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 06:12:55,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:55,145 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 06:12:55,145 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-16 06:12:55,146 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 06:12:55,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:55,148 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,148 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,149 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f empty. 2023-07-16 06:12:55,149 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9 empty. 2023-07-16 06:12:55,149 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,149 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,149 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 06:12:55,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:55,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:55,561 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-16 06:12:55,563 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6df37d119c2b028fcde7ac4d04be4bd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:12:55,563 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e442c435a16a6535528e547da893e87f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp 2023-07-16 06:12:55,598 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:55,598 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e442c435a16a6535528e547da893e87f, disabling compactions & flushes 2023-07-16 06:12:55,598 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:55,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:55,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. after waiting 0 ms 2023-07-16 06:12:55,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:55,599 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:55,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e442c435a16a6535528e547da893e87f: 2023-07-16 06:12:55,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:55,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 6df37d119c2b028fcde7ac4d04be4bd9, disabling compactions & flushes 2023-07-16 06:12:55,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:55,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:55,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. after waiting 0 ms 2023-07-16 06:12:55,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:55,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:55,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 6df37d119c2b028fcde7ac4d04be4bd9: 2023-07-16 06:12:55,610 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 06:12:55,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487975611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487975611"}]},"ts":"1689487975611"} 2023-07-16 06:12:55,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487975611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487975611"}]},"ts":"1689487975611"} 2023-07-16 06:12:55,614 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 06:12:55,614 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 06:12:55,614 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487975614"}]},"ts":"1689487975614"} 2023-07-16 06:12:55,616 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-16 06:12:55,620 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 06:12:55,622 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 06:12:55,622 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 06:12:55,622 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 06:12:55,622 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 06:12:55,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e442c435a16a6535528e547da893e87f, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6df37d119c2b028fcde7ac4d04be4bd9, ASSIGN}] 2023-07-16 06:12:55,625 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e442c435a16a6535528e547da893e87f, ASSIGN 2023-07-16 06:12:55,625 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6df37d119c2b028fcde7ac4d04be4bd9, ASSIGN 2023-07-16 06:12:55,626 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e442c435a16a6535528e547da893e87f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35311,1689487858185; forceNewPlan=false, retain=false 2023-07-16 06:12:55,626 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6df37d119c2b028fcde7ac4d04be4bd9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41391,1689487858033; forceNewPlan=false, retain=false 2023-07-16 06:12:55,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:55,776 INFO [jenkins-hbase4:46097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 06:12:55,780 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e442c435a16a6535528e547da893e87f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:55,780 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6df37d119c2b028fcde7ac4d04be4bd9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:55,780 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487975780"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487975780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487975780"}]},"ts":"1689487975780"} 2023-07-16 06:12:55,780 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487975780"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487975780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487975780"}]},"ts":"1689487975780"} 2023-07-16 06:12:55,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure e442c435a16a6535528e547da893e87f, server=jenkins-hbase4.apache.org,35311,1689487858185}] 2023-07-16 06:12:55,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 6df37d119c2b028fcde7ac4d04be4bd9, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:12:55,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:55,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e442c435a16a6535528e547da893e87f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 06:12:55,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:55,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6df37d119c2b028fcde7ac4d04be4bd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 06:12:55,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. service=AccessControlService 2023-07-16 06:12:55,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. service=AccessControlService 2023-07-16 06:12:55,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:55,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 06:12:55,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:55,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 06:12:55,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,943 INFO [StoreOpener-e442c435a16a6535528e547da893e87f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,943 INFO [StoreOpener-6df37d119c2b028fcde7ac4d04be4bd9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,945 DEBUG [StoreOpener-e442c435a16a6535528e547da893e87f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf 2023-07-16 06:12:55,945 DEBUG [StoreOpener-e442c435a16a6535528e547da893e87f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf 2023-07-16 06:12:55,945 DEBUG [StoreOpener-6df37d119c2b028fcde7ac4d04be4bd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf 2023-07-16 06:12:55,945 DEBUG [StoreOpener-6df37d119c2b028fcde7ac4d04be4bd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf 2023-07-16 06:12:55,946 INFO [StoreOpener-e442c435a16a6535528e547da893e87f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e442c435a16a6535528e547da893e87f columnFamilyName cf 2023-07-16 06:12:55,947 INFO [StoreOpener-6df37d119c2b028fcde7ac4d04be4bd9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6df37d119c2b028fcde7ac4d04be4bd9 columnFamilyName cf 2023-07-16 06:12:55,947 INFO [StoreOpener-e442c435a16a6535528e547da893e87f-1] regionserver.HStore(310): Store=e442c435a16a6535528e547da893e87f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:55,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,949 INFO [StoreOpener-6df37d119c2b028fcde7ac4d04be4bd9-1] regionserver.HStore(310): Store=6df37d119c2b028fcde7ac4d04be4bd9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 06:12:55,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e442c435a16a6535528e547da893e87f 2023-07-16 06:12:55,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:12:55,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:55,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e442c435a16a6535528e547da893e87f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72897151, jitterRate=0.08625219762325287}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:55,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e442c435a16a6535528e547da893e87f: 2023-07-16 06:12:55,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 06:12:55,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f., pid=108, masterSystemTime=1689487975937 2023-07-16 06:12:55,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6df37d119c2b028fcde7ac4d04be4bd9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72001547, jitterRate=0.07290665805339813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 06:12:55,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6df37d119c2b028fcde7ac4d04be4bd9: 2023-07-16 06:12:55,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9., pid=109, masterSystemTime=1689487975937 2023-07-16 06:12:55,960 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e442c435a16a6535528e547da893e87f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:55,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:55,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:55,961 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487975960"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487975960"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487975960"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487975960"}]},"ts":"1689487975960"} 2023-07-16 06:12:55,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:55,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:55,963 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6df37d119c2b028fcde7ac4d04be4bd9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:55,963 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487975963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689487975963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689487975963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689487975963"}]},"ts":"1689487975963"} 2023-07-16 06:12:55,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-16 06:12:55,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure e442c435a16a6535528e547da893e87f, server=jenkins-hbase4.apache.org,35311,1689487858185 in 178 msec 2023-07-16 06:12:55,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-16 06:12:55,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 6df37d119c2b028fcde7ac4d04be4bd9, server=jenkins-hbase4.apache.org,41391,1689487858033 in 180 msec 2023-07-16 06:12:55,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e442c435a16a6535528e547da893e87f, ASSIGN in 343 msec 2023-07-16 06:12:55,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-16 06:12:55,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6df37d119c2b028fcde7ac4d04be4bd9, ASSIGN in 345 msec 2023-07-16 06:12:55,971 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 06:12:55,971 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487975971"}]},"ts":"1689487975971"} 2023-07-16 06:12:55,973 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-16 06:12:55,985 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 06:12:55,985 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-16 06:12:55,987 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 06:12:55,989 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:55,989 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:55,989 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:55,989 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:12:55,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:55,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:55,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:55,992 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 06:12:55,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 851 msec 2023-07-16 06:12:56,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 06:12:56,253 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-16 06:12:56,256 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,256 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:56,260 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:56,275 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:56,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487976275 (current time:1689487976275). 2023-07-16 06:12:56,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:56,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x1a0aceb2 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:56,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76b14380, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:56,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:56,307 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:56,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a0aceb2 to 127.0.0.1:58206 2023-07-16 06:12:56,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:56,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x132e1ee1 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:56,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f9d3d68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:56,415 DEBUG [hconnection-0x234cc858-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:56,420 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:56,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x132e1ee1 to 127.0.0.1:58206 2023-07-16 06:12:56,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:56,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 06:12:56,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:56,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:56,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:56,435 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:56,436 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689488576436 2023-07-16 06:12:56,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:56,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,438 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:56,438 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:56,440 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:56,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:56,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-16 06:12:56,443 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:56,451 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689488576451 2023-07-16 06:12:56,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,476 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 06:12:56,476 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:56,478 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 06:12:56,478 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 06:12:56,478 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,478 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,481 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,481 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,481 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,481 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,482 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,482 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 06:12:56,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 06:12:56,486 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,486 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:56,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 06:12:56,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,486 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:56,486 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:56,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,487 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:56,487 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:56,487 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:56,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,487 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:56,487 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:56,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:56,493 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:56,493 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:56,493 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:56,501 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:56,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:56,501 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,501 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,501 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:56,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 06:12:56,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c197717[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:56,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 06:12:56,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c197717[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:56,508 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 06:12:56,508 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,509 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,509 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,509 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,509 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,509 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:56,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,510 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:56,510 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:56,510 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:12:56,510 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:56,510 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:56,510 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:56,510 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. started... 2023-07-16 06:12:56,513 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:56,515 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:56,515 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:56,515 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e442c435a16a6535528e547da893e87f: 2023-07-16 06:12:56,515 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,515 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:56,515 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:56,510 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,520 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:56,511 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:56,553 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:56,553 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:56,553 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:56,553 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. started... 2023-07-16 06:12:56,555 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:56,555 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6df37d119c2b028fcde7ac4d04be4bd9: 2023-07-16 06:12:56,556 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,556 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:56,556 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 06:12:56,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:56,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:56,557 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:56,575 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. completed. 2023-07-16 06:12:56,575 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:56,575 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:56,575 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:56,575 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,575 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:56,575 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:12:56,576 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. completed. 2023-07-16 06:12:56,576 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:12:56,578 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:56,578 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,578 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:56,578 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:56,581 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:56,581 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:56,581 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:56,581 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:56,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35311,1689487858185': 2023-07-16 06:12:56,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 06:12:56,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:56,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:56,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:56,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:56,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:56,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:12:56,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 06:12:56,592 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 06:12:56,592 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:56,592 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:56,592 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,593 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:56,594 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,594 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,594 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:56,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,594 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:56,594 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:56,594 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:56,595 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:56,598 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,598 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:56,599 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,601 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:56,605 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,606 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,609 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,609 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:56,609 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,609 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,609 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:56,609 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:56,610 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,610 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,610 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,612 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,612 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,612 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,612 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,612 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,612 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,612 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,612 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,612 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:56,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:12:56,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:56,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:56,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:56,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 06:12:56,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 06:12:56,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,755 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689487976437Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689487976625 (+188 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689487976625Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689487976625Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689487976629 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689487976668 (+39 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689487976754 (+86 ms) 2023-07-16 06:12:56,757 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:56,759 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:56,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:56,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:56,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 321 msec 2023-07-16 06:12:56,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35311] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:56,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41391] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 06:12:56,767 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,767 DEBUG [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:56,767 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 06:12:56,778 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:56,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689487976778 (current time:1689487976778). 2023-07-16 06:12:56,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 06:12:56,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x087bf335 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:56,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4db0e46a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:56,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:56,795 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:56,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x087bf335 to 127.0.0.1:58206 2023-07-16 06:12:56,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:56,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(139): Connect 0x781d0a50 to 127.0.0.1:58206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 06:12:56,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fa8ac3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 06:12:56,806 DEBUG [hconnection-0x65f19e16-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 06:12:56,807 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 06:12:56,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x781d0a50 to 127.0.0.1:58206 2023-07-16 06:12:56,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:12:56,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 06:12:56,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 06:12:56,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:56,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:56,822 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:56,823 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689488576823 2023-07-16 06:12:56,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 06:12:56,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,824 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 06:12:56,824 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 06:12:56,827 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 06:12:56,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:56,830 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-16 06:12:56,831 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:56,831 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689488576831 2023-07-16 06:12:56,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,887 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 06:12:56,887 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:56,888 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 06:12:56,888 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 06:12:56,889 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,889 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,892 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,892 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,892 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,892 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:56,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:56,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:56,892 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,893 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,893 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,893 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 06:12:56,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 06:12:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 06:12:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 06:12:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,894 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:56,894 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 06:12:56,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,899 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:56,899 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:56,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,909 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:56,910 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 06:12:56,910 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:56,901 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:56,910 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 06:12:56,913 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:56,914 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 06:12:56,914 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:56,912 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:56,914 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:56,914 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 06:12:56,914 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34953,1689487858121' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:56,914 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 06:12:56,916 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,916 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,917 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:56,917 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,917 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,917 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,917 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,917 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:56,917 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:56,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:56,918 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,918 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 06:12:56,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:56,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35311,1689487858185' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 06:12:56,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ac75bde[Count = 1] remaining members to acquire global barrier 2023-07-16 06:12:56,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:56,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:56,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:56,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:56,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:56,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41391,1689487858033' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 06:12:56,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ac75bde[Count = 0] remaining members to acquire global barrier 2023-07-16 06:12:56,923 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 06:12:56,923 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,924 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:56,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:56,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:56,926 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 06:12:56,929 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,929 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,929 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,929 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:56,929 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:56,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,929 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:56,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:56,930 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:56,930 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 06:12:56,930 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:56,930 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:56,930 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. started... 2023-07-16 06:12:56,930 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:56,930 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:56,930 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 06:12:56,930 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6df37d119c2b028fcde7ac4d04be4bd9 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 06:12:56,930 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34953,1689487858121' in zk 2023-07-16 06:12:56,932 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:56,933 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:56,933 DEBUG [member: 'jenkins-hbase4.apache.org,34953,1689487858121' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:56,936 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 06:12:56,936 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 06:12:56,938 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:56,938 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. started... 2023-07-16 06:12:56,938 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e442c435a16a6535528e547da893e87f 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 06:12:56,994 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071674128e10f52c4267bbba0a63a70e0056 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071674128e10f52c4267bbba0a63a70e0056 2023-07-16 06:12:57,020 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/.tmp/cf/81e1193ffa8b4cbbbbdf2952d846426a 2023-07-16 06:12:57,026 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/.tmp/cf/81e1193ffa8b4cbbbbdf2952d846426a as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf/81e1193ffa8b4cbbbbdf2952d846426a 2023-07-16 06:12:57,031 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf/81e1193ffa8b4cbbbbdf2952d846426a, entries=2, sequenceid=6, filesize=5.2 K 2023-07-16 06:12:57,032 INFO [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e442c435a16a6535528e547da893e87f in 94ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:57,032 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 06:12:57,033 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e442c435a16a6535528e547da893e87f: 2023-07-16 06:12:57,033 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,033 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:57,033 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf/81e1193ffa8b4cbbbbdf2952d846426a] hfiles 2023-07-16 06:12:57,033 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf/81e1193ffa8b4cbbbbdf2952d846426a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,058 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. completed. 2023-07-16 06:12:57,058 DEBUG [rs(jenkins-hbase4.apache.org,35311,1689487858185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:12:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35311,1689487858185' in zk 2023-07-16 06:12:57,060 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,060 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:57,060 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:57,060 DEBUG [member: 'jenkins-hbase4.apache.org,35311,1689487858185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:57,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:57,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:57,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:57,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35311,1689487858185': 2023-07-16 06:12:57,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35311,1689487858185' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 06:12:57,126 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:57,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:57,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:57,127 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 06:12:57,401 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716feb4bb4d1a454c5786b7dee060711b1e to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716feb4bb4d1a454c5786b7dee060711b1e 2023-07-16 06:12:57,409 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/.tmp/cf/bc5f2ba5555b424494fa861f45a739f6 2023-07-16 06:12:57,414 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/.tmp/cf/bc5f2ba5555b424494fa861f45a739f6 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf/bc5f2ba5555b424494fa861f45a739f6 2023-07-16 06:12:57,418 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf/bc5f2ba5555b424494fa861f45a739f6, entries=48, sequenceid=6, filesize=13.5 K 2023-07-16 06:12:57,423 INFO [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 6df37d119c2b028fcde7ac4d04be4bd9 in 493ms, sequenceid=6, compaction requested=false 2023-07-16 06:12:57,424 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6df37d119c2b028fcde7ac4d04be4bd9: 2023-07-16 06:12:57,424 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,425 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 06:12:57,425 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf/bc5f2ba5555b424494fa861f45a739f6] hfiles 2023-07-16 06:12:57,425 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf/bc5f2ba5555b424494fa861f45a739f6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,428 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:57,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:57,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 06:12:57,429 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 06:12:57,433 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. completed. 2023-07-16 06:12:57,433 DEBUG [rs(jenkins-hbase4.apache.org,41391,1689487858033)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:12:57,433 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 06:12:57,433 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 06:12:57,433 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,433 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 06:12:57,433 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41391,1689487858033' in zk 2023-07-16 06:12:57,436 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 06:12:57,436 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,436 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:57,436 DEBUG [member: 'jenkins-hbase4.apache.org,41391,1689487858033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 06:12:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:57,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:57,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:57,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41391,1689487858033': 2023-07-16 06:12:57,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41391,1689487858033' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 06:12:57,443 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 06:12:57,443 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 06:12:57,443 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 06:12:57,443 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,443 INFO [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 06:12:57,445 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,445 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,445 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,445 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,445 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:57,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,445 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:57,445 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:57,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 06:12:57,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 06:12:57,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:57,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 06:12:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,447 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:57,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:57,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,448 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 06:12:57,459 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 06:12:57,462 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,463 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,463 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:12:57,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:57,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,467 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,467 DEBUG [(jenkins-hbase4.apache.org,46097,1689487856540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:57,467 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:12:57,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:57,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 06:12:57,467 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 06:12:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 06:12:57,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 06:12:57,470 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:12:57,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:57,470 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:57,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:57,470 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:57,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 06:12:57,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 06:12:57,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716feb4bb4d1a454c5786b7dee060711b1e, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071674128e10f52c4267bbba0a63a70e0056] mob files 2023-07-16 06:12:57,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716feb4bb4d1a454c5786b7dee060711b1e 2023-07-16 06:12:57,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071674128e10f52c4267bbba0a63a70e0056 2023-07-16 06:12:57,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 06:12:57,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,551 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689487976823Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689487977481 (+658 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689487977481Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689487977481Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689487977486 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689487977508 (+22 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689487977550 (+42 ms) 2023-07-16 06:12:57,554 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 06:12:57,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 728 msec 2023-07-16 06:12:57,929 DEBUG [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 06:12:57,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 06:12:57,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 06:12:57,931 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931 2023-07-16 06:12:57,931 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37171, tgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931, rawTgtDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931, srcFsUri=hdfs://localhost:37171, srcDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:12:57,964 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2 2023-07-16 06:12:57,964 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1110455202_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:57,964 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37171, inputRoot=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2, snapshotDir=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-16 06:12:57,978 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:12:58,018 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,018 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,019 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,019 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,020 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,020 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,021 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,131 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/hadoop-7305669309596807658.jar 2023-07-16 06:12:58,132 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,132 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,133 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,133 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,134 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,134 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 06:12:58,135 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 06:12:58,135 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 06:12:58,136 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 06:12:58,136 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 06:12:58,137 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 06:12:58,138 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 06:12:58,138 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 06:12:58,138 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 06:12:58,139 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 06:12:58,140 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 06:12:58,140 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:58,141 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:58,141 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:58,142 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:58,142 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 06:12:58,143 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:58,143 DEBUG [Listener at jenkins-hbase4.apache.org/41271] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 06:12:59,404 WARN [Listener at jenkins-hbase4.apache.org/41271] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 06:12:59,407 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-16 06:12:59,410 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-16 06:12:59,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0006_000001 (auth:SIMPLE) 2023-07-16 06:12:59,609 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:12:59,609 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 06:13:00,312 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0007_000001 (auth:SIMPLE) 2023-07-16 06:13:00,463 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:13:05,663 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0007_000001 (auth:SIMPLE) 2023-07-16 06:13:07,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0007_000001 (auth:SIMPLE) 2023-07-16 06:13:11,884 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689487866190_0007_000001 (auth:SIMPLE) 2023-07-16 06:13:13,804 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 06:13:13,804 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 06:13:13,819 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:13,819 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 06:13:13,820 INFO [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 06:13:13,820 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:13,821 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 06:13:13,821 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 06:13:13,821 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_499812108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:13,821 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 06:13:13,821 DEBUG [Listener at jenkins-hbase4.apache.org/41271] snapshot.TestExportSnapshot(367): hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/export-test/export-1689487977931/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 06:13:13,827 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:13,827 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:13,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:13,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 06:13:13,831 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487993831"}]},"ts":"1689487993831"} 2023-07-16 06:13:13,833 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-16 06:13:13,836 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-16 06:13:13,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e442c435a16a6535528e547da893e87f, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6df37d119c2b028fcde7ac4d04be4bd9, UNASSIGN}] 2023-07-16 06:13:13,838 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e442c435a16a6535528e547da893e87f, UNASSIGN 2023-07-16 06:13:13,839 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6df37d119c2b028fcde7ac4d04be4bd9, UNASSIGN 2023-07-16 06:13:13,839 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e442c435a16a6535528e547da893e87f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:13:13,839 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6df37d119c2b028fcde7ac4d04be4bd9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:13:13,839 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487993839"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487993839"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487993839"}]},"ts":"1689487993839"} 2023-07-16 06:13:13,839 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487993839"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689487993839"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689487993839"}]},"ts":"1689487993839"} 2023-07-16 06:13:13,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure e442c435a16a6535528e547da893e87f, server=jenkins-hbase4.apache.org,35311,1689487858185}] 2023-07-16 06:13:13,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 6df37d119c2b028fcde7ac4d04be4bd9, server=jenkins-hbase4.apache.org,41391,1689487858033}] 2023-07-16 06:13:13,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 06:13:13,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e442c435a16a6535528e547da893e87f 2023-07-16 06:13:13,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:13:13,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e442c435a16a6535528e547da893e87f, disabling compactions & flushes 2023-07-16 06:13:13,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:13:13,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6df37d119c2b028fcde7ac4d04be4bd9, disabling compactions & flushes 2023-07-16 06:13:13,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:13:13,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. after waiting 0 ms 2023-07-16 06:13:13,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:13:13,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:13:13,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:13:13,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. after waiting 0 ms 2023-07-16 06:13:13,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:13:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:13:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:13:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:14,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f. 2023-07-16 06:13:14,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e442c435a16a6535528e547da893e87f: 2023-07-16 06:13:14,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:14,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9. 2023-07-16 06:13:14,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6df37d119c2b028fcde7ac4d04be4bd9: 2023-07-16 06:13:14,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e442c435a16a6535528e547da893e87f 2023-07-16 06:13:14,010 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e442c435a16a6535528e547da893e87f, regionState=CLOSED 2023-07-16 06:13:14,010 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487994010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487994010"}]},"ts":"1689487994010"} 2023-07-16 06:13:14,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:13:14,011 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6df37d119c2b028fcde7ac4d04be4bd9, regionState=CLOSED 2023-07-16 06:13:14,011 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689487994011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689487994011"}]},"ts":"1689487994011"} 2023-07-16 06:13:14,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-16 06:13:14,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure e442c435a16a6535528e547da893e87f, server=jenkins-hbase4.apache.org,35311,1689487858185 in 171 msec 2023-07-16 06:13:14,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-16 06:13:14,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 6df37d119c2b028fcde7ac4d04be4bd9, server=jenkins-hbase4.apache.org,41391,1689487858033 in 171 msec 2023-07-16 06:13:14,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e442c435a16a6535528e547da893e87f, UNASSIGN in 179 msec 2023-07-16 06:13:14,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-16 06:13:14,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6df37d119c2b028fcde7ac4d04be4bd9, UNASSIGN in 179 msec 2023-07-16 06:13:14,018 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689487994018"}]},"ts":"1689487994018"} 2023-07-16 06:13:14,019 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-16 06:13:14,021 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-16 06:13:14,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-07-16 06:13:14,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 06:13:14,134 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-16 06:13:14,135 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,143 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,145 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,145 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41391] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,149 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,149 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,149 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,149 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 06:13:14,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 06:13:14,151 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 06:13:14,151 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 06:13:14,152 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,152 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,152 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:13:14,152 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,153 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:13:14,152 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:13:14,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 06:13:14,159 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f 2023-07-16 06:13:14,159 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,159 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 06:13:14,159 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:13:14,162 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/recovered.edits] 2023-07-16 06:13:14,162 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf, FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/recovered.edits] 2023-07-16 06:13:14,176 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf/bc5f2ba5555b424494fa861f45a739f6 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/cf/bc5f2ba5555b424494fa861f45a739f6 2023-07-16 06:13:14,177 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf/81e1193ffa8b4cbbbbdf2952d846426a to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/cf/81e1193ffa8b4cbbbbdf2952d846426a 2023-07-16 06:13:14,182 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9/recovered.edits/9.seqid 2023-07-16 06:13:14,182 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/recovered.edits/9.seqid to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f/recovered.edits/9.seqid 2023-07-16 06:13:14,183 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6df37d119c2b028fcde7ac4d04be4bd9 2023-07-16 06:13:14,183 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e442c435a16a6535528e547da893e87f 2023-07-16 06:13:14,183 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 06:13:14,183 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-16 06:13:14,184 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-16 06:13:14,189 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716feb4bb4d1a454c5786b7dee060711b1e to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716feb4bb4d1a454c5786b7dee060711b1e 2023-07-16 06:13:14,190 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071674128e10f52c4267bbba0a63a70e0056 to hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071674128e10f52c4267bbba0a63a70e0056 2023-07-16 06:13:14,191 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-16 06:13:14,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,195 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-16 06:13:14,200 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-16 06:13:14,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-16 06:13:14,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487994203"}]},"ts":"9223372036854775807"} 2023-07-16 06:13:14,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689487994203"}]},"ts":"9223372036854775807"} 2023-07-16 06:13:14,205 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 06:13:14,205 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e442c435a16a6535528e547da893e87f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689487975141.e442c435a16a6535528e547da893e87f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6df37d119c2b028fcde7ac4d04be4bd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689487975141.6df37d119c2b028fcde7ac4d04be4bd9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 06:13:14,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-16 06:13:14,205 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689487994205"}]},"ts":"9223372036854775807"} 2023-07-16 06:13:14,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-16 06:13:14,214 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 78 msec 2023-07-16 06:13:14,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 06:13:14,256 INFO [Listener at jenkins-hbase4.apache.org/41271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-16 06:13:14,265 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 06:13:14,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,271 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 06:13:14,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 06:13:14,303 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 763), OpenFileDescriptor=896 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=630 (was 609) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=1724 (was 1912) 2023-07-16 06:13:14,303 WARN [Listener at jenkins-hbase4.apache.org/41271] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 06:13:14,304 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-16 06:13:14,317 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 06:13:14,431 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689487866190_0007_01_000001 is : 143 2023-07-16 06:13:19,585 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 06:13:28,446 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 06:13:42,602 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 06:13:42,603 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 06:13:42,728 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-16 06:13:42,741 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-16 06:13:42,743 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 06:13:42,767 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 06:13:42,872 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 06:13:42,872 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-16 06:13:42,872 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-16 06:13:42,872 INFO [Listener at jenkins-hbase4.apache.org/41271] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-16 06:13:42,872 DEBUG [Listener at jenkins-hbase4.apache.org/41271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29a226bb to 127.0.0.1:58206 2023-07-16 06:13:42,872 DEBUG [Listener at jenkins-hbase4.apache.org/41271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:42,874 DEBUG [Listener at jenkins-hbase4.apache.org/41271] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-16 06:13:42,874 DEBUG [Listener at jenkins-hbase4.apache.org/41271] util.JVMClusterUtil(257): Found active master hash=727074255, stopped=false 2023-07-16 06:13:42,874 DEBUG [Listener at jenkins-hbase4.apache.org/41271] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:42,874 DEBUG [Listener at jenkins-hbase4.apache.org/41271] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 06:13:42,874 INFO [Listener at jenkins-hbase4.apache.org/41271] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:13:42,876 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 06:13:42,876 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 06:13:42,876 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:13:42,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:13:42,876 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 06:13:42,876 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 06:13:42,876 INFO [Listener at jenkins-hbase4.apache.org/41271] procedure2.ProcedureExecutor(629): Stopping 2023-07-16 06:13:42,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:13:42,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:13:42,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 06:13:42,877 DEBUG [Listener at jenkins-hbase4.apache.org/41271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5523a838 to 127.0.0.1:58206 2023-07-16 06:13:42,877 DEBUG [Listener at jenkins-hbase4.apache.org/41271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:42,878 INFO [Listener at jenkins-hbase4.apache.org/41271] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41391,1689487858033' ***** 2023-07-16 06:13:42,878 DEBUG [Listener at jenkins-hbase4.apache.org/41271] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:42,878 INFO [Listener at jenkins-hbase4.apache.org/41271] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 06:13:42,878 INFO [Listener at jenkins-hbase4.apache.org/41271] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34953,1689487858121' ***** 2023-07-16 06:13:42,878 INFO [RS:0;jenkins-hbase4:41391] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 06:13:42,879 INFO [RS:0;jenkins-hbase4:41391] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 06:13:42,879 INFO [RS:0;jenkins-hbase4:41391] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 06:13:42,879 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 06:13:42,879 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(3305): Received CLOSE for 6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:13:42,879 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:13:42,879 DEBUG [RS:0;jenkins-hbase4:41391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26498b02 to 127.0.0.1:58206 2023-07-16 06:13:42,879 DEBUG [RS:0;jenkins-hbase4:41391] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:42,881 INFO [RS:0;jenkins-hbase4:41391] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 06:13:42,882 INFO [RS:0;jenkins-hbase4:41391] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 06:13:42,882 INFO [RS:0;jenkins-hbase4:41391] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 06:13:42,882 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-16 06:13:42,883 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-16 06:13:42,883 DEBUG [Listener at jenkins-hbase4.apache.org/41271] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:42,883 INFO [Listener at jenkins-hbase4.apache.org/41271] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 06:13:42,883 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1478): Online Regions={6a71831d1301b145f7828dd65b2ab134=hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134., 1588230740=hbase:meta,,1.1588230740} 2023-07-16 06:13:42,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6a71831d1301b145f7828dd65b2ab134, disabling compactions & flushes 2023-07-16 06:13:42,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:13:42,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 06:13:42,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 06:13:42,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 06:13:42,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 06:13:42,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 06:13:42,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-16 06:13:42,884 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1504): Waiting on 1588230740, 6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:13:42,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:13:42,883 INFO [Listener at jenkins-hbase4.apache.org/41271] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35311,1689487858185' ***** 2023-07-16 06:13:42,885 DEBUG [Listener at jenkins-hbase4.apache.org/41271] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:42,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. after waiting 0 ms 2023-07-16 06:13:42,884 INFO [RS:1;jenkins-hbase4:34953] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 06:13:42,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:13:42,885 INFO [RS:1;jenkins-hbase4:34953] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 06:13:42,885 INFO [RS:1;jenkins-hbase4:34953] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 06:13:42,885 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(3305): Received CLOSE for c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:13:42,885 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:13:42,885 DEBUG [RS:1;jenkins-hbase4:34953] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x612c5185 to 127.0.0.1:58206 2023-07-16 06:13:42,886 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 06:13:42,886 DEBUG [RS:1;jenkins-hbase4:34953] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:42,885 INFO [Listener at jenkins-hbase4.apache.org/41271] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 06:13:42,889 INFO [RS:2;jenkins-hbase4:35311] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 06:13:42,888 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 06:13:42,889 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 06:13:42,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c99c0fe6a51f54b7c94b625acb1d0d07, disabling compactions & flushes 2023-07-16 06:13:42,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:13:42,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:13:42,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. after waiting 0 ms 2023-07-16 06:13:42,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:13:42,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c99c0fe6a51f54b7c94b625acb1d0d07 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-16 06:13:42,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6a71831d1301b145f7828dd65b2ab134 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-16 06:13:42,889 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1478): Online Regions={c99c0fe6a51f54b7c94b625acb1d0d07=hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07.} 2023-07-16 06:13:42,889 INFO [RS:2;jenkins-hbase4:35311] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 06:13:42,890 INFO [RS:2;jenkins-hbase4:35311] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 06:13:42,890 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1504): Waiting on c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:13:42,890 INFO [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:13:42,890 DEBUG [RS:2;jenkins-hbase4:35311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c60ef52 to 127.0.0.1:58206 2023-07-16 06:13:42,890 DEBUG [RS:2;jenkins-hbase4:35311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:42,891 INFO [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35311,1689487858185; all regions closed. 2023-07-16 06:13:42,933 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:42,934 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:42,954 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:42,995 DEBUG [RS:2;jenkins-hbase4:35311] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/oldWALs 2023-07-16 06:13:42,995 INFO [RS:2;jenkins-hbase4:35311] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35311%2C1689487858185:(num 1689487860478) 2023-07-16 06:13:42,995 DEBUG [RS:2;jenkins-hbase4:35311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:42,995 INFO [RS:2;jenkins-hbase4:35311] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:42,995 INFO [RS:2;jenkins-hbase4:35311] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 06:13:42,999 INFO [RS:2;jenkins-hbase4:35311] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 06:13:43,000 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 06:13:43,000 INFO [RS:2;jenkins-hbase4:35311] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 06:13:43,000 INFO [RS:2;jenkins-hbase4:35311] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 06:13:43,007 INFO [RS:2;jenkins-hbase4:35311] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35311 2023-07-16 06:13:43,021 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:13:43,021 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:43,021 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:13:43,021 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:43,021 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35311,1689487858185 2023-07-16 06:13:43,021 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:43,021 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:43,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/.tmp/l/671e311a916a40fc8f39f0956cb9e521 2023-07-16 06:13:43,027 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35311,1689487858185] 2023-07-16 06:13:43,029 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35311,1689487858185; numProcessing=1 2023-07-16 06:13:43,030 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/.tmp/info/57db7c2a00d246589f353b4400baa3e6 2023-07-16 06:13:43,030 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35311,1689487858185 already deleted, retry=false 2023-07-16 06:13:43,030 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35311,1689487858185 expired; onlineServers=2 2023-07-16 06:13:43,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07/.tmp/info/1d9052c5f3154ebaa849e0a581571a6f 2023-07-16 06:13:43,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 671e311a916a40fc8f39f0956cb9e521 2023-07-16 06:13:43,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/.tmp/l/671e311a916a40fc8f39f0956cb9e521 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/l/671e311a916a40fc8f39f0956cb9e521 2023-07-16 06:13:43,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57db7c2a00d246589f353b4400baa3e6 2023-07-16 06:13:43,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 671e311a916a40fc8f39f0956cb9e521 2023-07-16 06:13:43,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/l/671e311a916a40fc8f39f0956cb9e521, entries=7, sequenceid=18, filesize=5.2 K 2023-07-16 06:13:43,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 6a71831d1301b145f7828dd65b2ab134 in 171ms, sequenceid=18, compaction requested=false 2023-07-16 06:13:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07/.tmp/info/1d9052c5f3154ebaa849e0a581571a6f as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07/info/1d9052c5f3154ebaa849e0a581571a6f 2023-07-16 06:13:43,085 DEBUG [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1504): Waiting on 1588230740, 6a71831d1301b145f7828dd65b2ab134 2023-07-16 06:13:43,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07/info/1d9052c5f3154ebaa849e0a581571a6f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-16 06:13:43,090 DEBUG [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1504): Waiting on c99c0fe6a51f54b7c94b625acb1d0d07 2023-07-16 06:13:43,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c99c0fe6a51f54b7c94b625acb1d0d07 in 201ms, sequenceid=6, compaction requested=false 2023-07-16 06:13:43,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/acl/6a71831d1301b145f7828dd65b2ab134/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-16 06:13:43,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:43,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:13:43,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6a71831d1301b145f7828dd65b2ab134: 2023-07-16 06:13:43,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689487861941.6a71831d1301b145f7828dd65b2ab134. 2023-07-16 06:13:43,130 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:43,130 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:35311-0x1016cc153130003, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:43,130 INFO [RS:2;jenkins-hbase4:35311] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35311,1689487858185; zookeeper connection closed. 2023-07-16 06:13:43,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/namespace/c99c0fe6a51f54b7c94b625acb1d0d07/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 06:13:43,135 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5dfaf339] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5dfaf339 2023-07-16 06:13:43,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/.tmp/rep_barrier/df51e2e484714cfb8a1833de7b69cfe9 2023-07-16 06:13:43,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:43,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:13:43,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c99c0fe6a51f54b7c94b625acb1d0d07: 2023-07-16 06:13:43,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689487861076.c99c0fe6a51f54b7c94b625acb1d0d07. 2023-07-16 06:13:43,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df51e2e484714cfb8a1833de7b69cfe9 2023-07-16 06:13:43,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/.tmp/table/a4944124f7ad4f21938b6d605a31d556 2023-07-16 06:13:43,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4944124f7ad4f21938b6d605a31d556 2023-07-16 06:13:43,180 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/.tmp/info/57db7c2a00d246589f353b4400baa3e6 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/info/57db7c2a00d246589f353b4400baa3e6 2023-07-16 06:13:43,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57db7c2a00d246589f353b4400baa3e6 2023-07-16 06:13:43,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/info/57db7c2a00d246589f353b4400baa3e6, entries=48, sequenceid=131, filesize=10.3 K 2023-07-16 06:13:43,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/.tmp/rep_barrier/df51e2e484714cfb8a1833de7b69cfe9 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/rep_barrier/df51e2e484714cfb8a1833de7b69cfe9 2023-07-16 06:13:43,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df51e2e484714cfb8a1833de7b69cfe9 2023-07-16 06:13:43,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/rep_barrier/df51e2e484714cfb8a1833de7b69cfe9, entries=13, sequenceid=131, filesize=6.4 K 2023-07-16 06:13:43,192 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/.tmp/table/a4944124f7ad4f21938b6d605a31d556 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/table/a4944124f7ad4f21938b6d605a31d556 2023-07-16 06:13:43,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4944124f7ad4f21938b6d605a31d556 2023-07-16 06:13:43,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/table/a4944124f7ad4f21938b6d605a31d556, entries=24, sequenceid=131, filesize=6.9 K 2023-07-16 06:13:43,201 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 317ms, sequenceid=131, compaction requested=false 2023-07-16 06:13:43,224 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-16 06:13:43,224 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-16 06:13:43,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-16 06:13:43,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 06:13:43,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 06:13:43,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 06:13:43,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 06:13:43,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-16 06:13:43,285 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41391,1689487858033; all regions closed. 2023-07-16 06:13:43,290 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34953,1689487858121; all regions closed. 2023-07-16 06:13:43,300 DEBUG [RS:0;jenkins-hbase4:41391] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/oldWALs 2023-07-16 06:13:43,301 INFO [RS:0;jenkins-hbase4:41391] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41391%2C1689487858033.meta:.meta(num 1689487860701) 2023-07-16 06:13:43,308 DEBUG [RS:1;jenkins-hbase4:34953] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/oldWALs 2023-07-16 06:13:43,308 INFO [RS:1;jenkins-hbase4:34953] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34953%2C1689487858121:(num 1689487860477) 2023-07-16 06:13:43,308 DEBUG [RS:1;jenkins-hbase4:34953] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:43,308 INFO [RS:1;jenkins-hbase4:34953] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:43,308 INFO [RS:1;jenkins-hbase4:34953] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 06:13:43,309 INFO [RS:1;jenkins-hbase4:34953] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 06:13:43,309 INFO [RS:1;jenkins-hbase4:34953] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 06:13:43,309 INFO [RS:1;jenkins-hbase4:34953] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 06:13:43,310 INFO [RS:1;jenkins-hbase4:34953] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34953 2023-07-16 06:13:43,310 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 06:13:43,313 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:43,313 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:13:43,313 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34953,1689487858121 2023-07-16 06:13:43,318 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34953,1689487858121] 2023-07-16 06:13:43,318 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34953,1689487858121; numProcessing=2 2023-07-16 06:13:43,319 DEBUG [RS:0;jenkins-hbase4:41391] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/oldWALs 2023-07-16 06:13:43,319 INFO [RS:0;jenkins-hbase4:41391] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41391%2C1689487858033:(num 1689487860476) 2023-07-16 06:13:43,319 DEBUG [RS:0;jenkins-hbase4:41391] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:43,319 INFO [RS:0;jenkins-hbase4:41391] regionserver.LeaseManager(133): Closed leases 2023-07-16 06:13:43,319 INFO [RS:0;jenkins-hbase4:41391] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-16 06:13:43,319 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 06:13:43,323 INFO [RS:0;jenkins-hbase4:41391] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41391 2023-07-16 06:13:43,418 INFO [RS:1;jenkins-hbase4:34953] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34953,1689487858121; zookeeper connection closed. 2023-07-16 06:13:43,419 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:43,419 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:34953-0x1016cc153130002, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:43,419 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@57a4c759] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@57a4c759 2023-07-16 06:13:43,420 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 06:13:43,420 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41391,1689487858033 2023-07-16 06:13:43,420 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34953,1689487858121 already deleted, retry=false 2023-07-16 06:13:43,421 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34953,1689487858121 expired; onlineServers=1 2023-07-16 06:13:43,423 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41391,1689487858033] 2023-07-16 06:13:43,423 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41391,1689487858033; numProcessing=3 2023-07-16 06:13:43,523 INFO [RS:0;jenkins-hbase4:41391] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41391,1689487858033; zookeeper connection closed. 2023-07-16 06:13:43,523 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:43,523 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): regionserver:41391-0x1016cc153130001, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:43,525 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ed6b77c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ed6b77c 2023-07-16 06:13:43,525 INFO [Listener at jenkins-hbase4.apache.org/41271] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-16 06:13:43,529 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41391,1689487858033 already deleted, retry=false 2023-07-16 06:13:43,529 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41391,1689487858033 expired; onlineServers=0 2023-07-16 06:13:43,529 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46097,1689487856540' ***** 2023-07-16 06:13:43,529 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-16 06:13:43,530 DEBUG [M:0;jenkins-hbase4:46097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6b4ff4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 06:13:43,530 INFO [M:0;jenkins-hbase4:46097] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46097,1689487856540 2023-07-16 06:13:43,530 INFO [M:0;jenkins-hbase4:46097] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46097,1689487856540; all regions closed. 2023-07-16 06:13:43,530 DEBUG [M:0;jenkins-hbase4:46097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 06:13:43,530 DEBUG [M:0;jenkins-hbase4:46097] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-16 06:13:43,530 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-16 06:13:43,530 DEBUG [M:0;jenkins-hbase4:46097] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-16 06:13:43,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689487859906] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689487859906,5,FailOnTimeoutGroup] 2023-07-16 06:13:43,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689487859907] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689487859907,5,FailOnTimeoutGroup] 2023-07-16 06:13:43,530 INFO [M:0;jenkins-hbase4:46097] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-16 06:13:43,530 INFO [M:0;jenkins-hbase4:46097] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-16 06:13:43,530 INFO [M:0;jenkins-hbase4:46097] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-16 06:13:43,530 DEBUG [M:0;jenkins-hbase4:46097] master.HMaster(1512): Stopping service threads 2023-07-16 06:13:43,531 INFO [M:0;jenkins-hbase4:46097] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-16 06:13:43,531 ERROR [M:0;jenkins-hbase4:46097] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-16 06:13:43,532 INFO [M:0;jenkins-hbase4:46097] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-16 06:13:43,532 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-16 06:13:43,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-16 06:13:43,532 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 06:13:43,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 06:13:43,533 DEBUG [M:0;jenkins-hbase4:46097] zookeeper.ZKUtil(398): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-16 06:13:43,533 WARN [M:0;jenkins-hbase4:46097] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-16 06:13:43,533 INFO [M:0;jenkins-hbase4:46097] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-16 06:13:43,533 INFO [M:0;jenkins-hbase4:46097] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-16 06:13:43,534 DEBUG [M:0;jenkins-hbase4:46097] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 06:13:43,534 INFO [M:0;jenkins-hbase4:46097] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:13:43,534 DEBUG [M:0;jenkins-hbase4:46097] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:13:43,534 DEBUG [M:0;jenkins-hbase4:46097] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 06:13:43,534 DEBUG [M:0;jenkins-hbase4:46097] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:13:43,534 INFO [M:0;jenkins-hbase4:46097] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.91 KB heapSize=452.16 KB 2023-07-16 06:13:43,585 INFO [M:0;jenkins-hbase4:46097] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.91 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/304c835cc23248648769cf918c042883 2023-07-16 06:13:43,589 INFO [M:0;jenkins-hbase4:46097] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 304c835cc23248648769cf918c042883 2023-07-16 06:13:43,590 DEBUG [M:0;jenkins-hbase4:46097] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/304c835cc23248648769cf918c042883 as hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/304c835cc23248648769cf918c042883 2023-07-16 06:13:43,596 INFO [M:0;jenkins-hbase4:46097] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 304c835cc23248648769cf918c042883 2023-07-16 06:13:43,596 INFO [M:0;jenkins-hbase4:46097] regionserver.HStore(1080): Added hdfs://localhost:37171/user/jenkins/test-data/66a6c081-d357-a053-7784-d737b86dcde2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/304c835cc23248648769cf918c042883, entries=119, sequenceid=899, filesize=28.7 K 2023-07-16 06:13:43,597 INFO [M:0;jenkins-hbase4:46097] regionserver.HRegion(2948): Finished flush of dataSize ~375.91 KB/384927, heapSize ~452.15 KB/463000, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 63ms, sequenceid=899, compaction requested=false 2023-07-16 06:13:43,616 INFO [M:0;jenkins-hbase4:46097] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 06:13:43,617 DEBUG [M:0;jenkins-hbase4:46097] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 06:13:43,632 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 06:13:43,632 INFO [M:0;jenkins-hbase4:46097] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-16 06:13:43,633 INFO [M:0;jenkins-hbase4:46097] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46097 2023-07-16 06:13:43,636 DEBUG [M:0;jenkins-hbase4:46097] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46097,1689487856540 already deleted, retry=false 2023-07-16 06:13:43,738 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:43,738 INFO [M:0;jenkins-hbase4:46097] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46097,1689487856540; zookeeper connection closed. 2023-07-16 06:13:43,738 DEBUG [Listener at localhost/44595-EventThread] zookeeper.ZKWatcher(600): master:46097-0x1016cc153130000, quorum=127.0.0.1:58206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 06:13:43,740 WARN [Listener at jenkins-hbase4.apache.org/41271] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 06:13:43,746 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 06:13:43,849 WARN [BP-76077675-172.31.14.131-1689487852489 heartbeating to localhost/127.0.0.1:37171] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 06:13:43,849 WARN [BP-76077675-172.31.14.131-1689487852489 heartbeating to localhost/127.0.0.1:37171] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-76077675-172.31.14.131-1689487852489 (Datanode Uuid cf5be3f6-2b54-442b-b79c-b547a8d977c6) service to localhost/127.0.0.1:37171 2023-07-16 06:13:43,851 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data5/current/BP-76077675-172.31.14.131-1689487852489] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:43,851 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data6/current/BP-76077675-172.31.14.131-1689487852489] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:43,853 WARN [Listener at jenkins-hbase4.apache.org/41271] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 06:13:43,856 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 06:13:43,862 WARN [BP-76077675-172.31.14.131-1689487852489 heartbeating to localhost/127.0.0.1:37171] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 06:13:43,862 WARN [BP-76077675-172.31.14.131-1689487852489 heartbeating to localhost/127.0.0.1:37171] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-76077675-172.31.14.131-1689487852489 (Datanode Uuid caf986c0-6aef-46e6-8949-237c83b14d27) service to localhost/127.0.0.1:37171 2023-07-16 06:13:43,863 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data3/current/BP-76077675-172.31.14.131-1689487852489] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:43,863 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data4/current/BP-76077675-172.31.14.131-1689487852489] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:43,865 WARN [Listener at jenkins-hbase4.apache.org/41271] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 06:13:43,868 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 06:13:43,975 WARN [BP-76077675-172.31.14.131-1689487852489 heartbeating to localhost/127.0.0.1:37171] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 06:13:43,975 WARN [BP-76077675-172.31.14.131-1689487852489 heartbeating to localhost/127.0.0.1:37171] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-76077675-172.31.14.131-1689487852489 (Datanode Uuid 40e26610-bd59-4c2a-8529-7ce6227e7c91) service to localhost/127.0.0.1:37171 2023-07-16 06:13:43,976 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data1/current/BP-76077675-172.31.14.131-1689487852489] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:43,977 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/edbcedc3-bd12-e6ce-f4f0-0d69656e21e8/cluster_072fec10-ed8e-6765-0358-fc29b6051071/dfs/data/data2/current/BP-76077675-172.31.14.131-1689487852489] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 06:13:44,040 INFO [Listener at jenkins-hbase4.apache.org/41271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 06:13:44,174 INFO [Listener at jenkins-hbase4.apache.org/41271] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-16 06:13:44,276 INFO [Listener at jenkins-hbase4.apache.org/41271] hbase.HBaseTestingUtility(1293): Minicluster is down