2023-07-16 22:10:45,016 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-16 22:10:45,251 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825 2023-07-16 22:10:45,252 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-16 22:10:45,252 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-16 22:10:45,289 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-16 22:10:45,520 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-16 22:10:45,521 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e, deleteOnExit=true 2023-07-16 22:10:45,521 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-16 22:10:45,521 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/test.cache.data in system properties and HBase conf 2023-07-16 22:10:45,522 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 22:10:45,522 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop.log.dir in system properties and HBase conf 2023-07-16 22:10:45,522 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 22:10:45,523 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 22:10:45,523 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 22:10:45,874 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-16 22:10:45,878 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 22:10:45,879 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 22:10:45,879 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 22:10:45,879 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 22:10:45,880 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 22:10:45,880 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 22:10:45,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 22:10:45,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 22:10:45,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 22:10:45,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/nfs.dump.dir in system properties and HBase conf 2023-07-16 22:10:45,883 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir in system properties and HBase conf 2023-07-16 22:10:45,883 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 22:10:45,884 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 22:10:45,884 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-16 22:10:46,481 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 22:10:46,485 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 22:10:46,757 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-16 22:10:46,936 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-16 22:10:46,954 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:46,992 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:47,039 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir/Jetty_localhost_39975_hdfs____.fwefmt/webapp 2023-07-16 22:10:47,187 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39975 2023-07-16 22:10:47,232 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 22:10:47,233 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 22:10:47,784 WARN [Listener at localhost/38033] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 22:10:47,876 WARN [Listener at localhost/38033] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 22:10:47,899 WARN [Listener at localhost/38033] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:47,907 INFO [Listener at localhost/38033] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:47,921 INFO [Listener at localhost/38033] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir/Jetty_localhost_39059_datanode____.sn8wvf/webapp 2023-07-16 22:10:48,047 INFO [Listener at localhost/38033] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39059 2023-07-16 22:10:48,594 WARN [Listener at localhost/42915] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 22:10:48,626 WARN [Listener at localhost/42915] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 22:10:48,630 WARN [Listener at localhost/42915] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:48,633 INFO [Listener at localhost/42915] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:48,641 INFO [Listener at localhost/42915] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir/Jetty_localhost_35253_datanode____d2p40l/webapp 2023-07-16 22:10:48,771 INFO [Listener at localhost/42915] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35253 2023-07-16 22:10:48,795 WARN [Listener at localhost/40501] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 22:10:48,845 WARN [Listener at localhost/40501] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 22:10:48,854 WARN [Listener at localhost/40501] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:48,856 INFO [Listener at localhost/40501] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:48,865 INFO [Listener at localhost/40501] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir/Jetty_localhost_39569_datanode____gmfhq1/webapp 2023-07-16 22:10:49,040 INFO [Listener at localhost/40501] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39569 2023-07-16 22:10:49,075 WARN [Listener at localhost/46301] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 22:10:49,366 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd136b6cd5675f235: Processing first storage report for DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd from datanode 5db885e4-4bb1-41de-a183-67c7eec14ce9 2023-07-16 22:10:49,368 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd136b6cd5675f235: from storage DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd node DatanodeRegistration(127.0.0.1:40069, datanodeUuid=5db885e4-4bb1-41de-a183-67c7eec14ce9, infoPort=36743, infoSecurePort=0, ipcPort=46301, storageInfo=lv=-57;cid=testClusterID;nsid=2098435454;c=1689545446556), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,368 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28e5e63b8f77efec: Processing first storage report for DS-8687eb49-26da-478b-984a-01e90d24d631 from datanode f9b02a95-ed46-4d5c-afae-b4df71efec0b 2023-07-16 22:10:49,368 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28e5e63b8f77efec: from storage DS-8687eb49-26da-478b-984a-01e90d24d631 node DatanodeRegistration(127.0.0.1:38565, datanodeUuid=f9b02a95-ed46-4d5c-afae-b4df71efec0b, infoPort=34099, infoSecurePort=0, ipcPort=40501, storageInfo=lv=-57;cid=testClusterID;nsid=2098435454;c=1689545446556), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb42c499a48eb7758: Processing first storage report for DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429 from datanode 65506098-fcf5-4b41-b48b-b73fdcd5bc92 2023-07-16 22:10:49,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb42c499a48eb7758: from storage DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429 node DatanodeRegistration(127.0.0.1:35503, datanodeUuid=65506098-fcf5-4b41-b48b-b73fdcd5bc92, infoPort=37357, infoSecurePort=0, ipcPort=42915, storageInfo=lv=-57;cid=testClusterID;nsid=2098435454;c=1689545446556), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd136b6cd5675f235: Processing first storage report for DS-d9236224-f250-402f-9068-88ecf4311cc1 from datanode 5db885e4-4bb1-41de-a183-67c7eec14ce9 2023-07-16 22:10:49,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd136b6cd5675f235: from storage DS-d9236224-f250-402f-9068-88ecf4311cc1 node DatanodeRegistration(127.0.0.1:40069, datanodeUuid=5db885e4-4bb1-41de-a183-67c7eec14ce9, infoPort=36743, infoSecurePort=0, ipcPort=46301, storageInfo=lv=-57;cid=testClusterID;nsid=2098435454;c=1689545446556), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28e5e63b8f77efec: Processing first storage report for DS-311167a8-3f2c-4758-9c84-7bb706340895 from datanode f9b02a95-ed46-4d5c-afae-b4df71efec0b 2023-07-16 22:10:49,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28e5e63b8f77efec: from storage DS-311167a8-3f2c-4758-9c84-7bb706340895 node DatanodeRegistration(127.0.0.1:38565, datanodeUuid=f9b02a95-ed46-4d5c-afae-b4df71efec0b, infoPort=34099, infoSecurePort=0, ipcPort=40501, storageInfo=lv=-57;cid=testClusterID;nsid=2098435454;c=1689545446556), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb42c499a48eb7758: Processing first storage report for DS-fc1379fa-6294-4a2c-a7a0-000c1c84dc73 from datanode 65506098-fcf5-4b41-b48b-b73fdcd5bc92 2023-07-16 22:10:49,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb42c499a48eb7758: from storage DS-fc1379fa-6294-4a2c-a7a0-000c1c84dc73 node DatanodeRegistration(127.0.0.1:35503, datanodeUuid=65506098-fcf5-4b41-b48b-b73fdcd5bc92, infoPort=37357, infoSecurePort=0, ipcPort=42915, storageInfo=lv=-57;cid=testClusterID;nsid=2098435454;c=1689545446556), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 22:10:49,594 DEBUG [Listener at localhost/46301] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825 2023-07-16 22:10:49,676 INFO [Listener at localhost/46301] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/zookeeper_0, clientPort=58223, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-16 22:10:49,697 INFO [Listener at localhost/46301] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58223 2023-07-16 22:10:49,708 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:49,710 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:50,394 INFO [Listener at localhost/46301] util.FSUtils(471): Created version file at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 with version=8 2023-07-16 22:10:50,394 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/hbase-staging 2023-07-16 22:10:50,765 INFO [Listener at localhost/46301] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-16 22:10:51,357 INFO [Listener at localhost/46301] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 22:10:51,416 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:51,417 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:51,417 INFO [Listener at localhost/46301] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 22:10:51,417 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:51,417 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 22:10:51,596 INFO [Listener at localhost/46301] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 22:10:51,693 DEBUG [Listener at localhost/46301] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-16 22:10:51,808 INFO [Listener at localhost/46301] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35007 2023-07-16 22:10:51,825 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:51,826 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:51,850 INFO [Listener at localhost/46301] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35007 connecting to ZooKeeper ensemble=127.0.0.1:58223 2023-07-16 22:10:51,903 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:350070x0, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 22:10:51,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35007-0x101703023b70000 connected 2023-07-16 22:10:51,935 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:10:51,936 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:10:51,956 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 22:10:51,967 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35007 2023-07-16 22:10:51,968 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35007 2023-07-16 22:10:51,968 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35007 2023-07-16 22:10:51,969 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35007 2023-07-16 22:10:51,970 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35007 2023-07-16 22:10:51,979 INFO [Listener at localhost/46301] master.HMaster(444): hbase.rootdir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6, hbase.cluster.distributed=false 2023-07-16 22:10:52,058 INFO [Listener at localhost/46301] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 22:10:52,059 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,059 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,059 INFO [Listener at localhost/46301] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 22:10:52,059 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,059 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 22:10:52,064 INFO [Listener at localhost/46301] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 22:10:52,068 INFO [Listener at localhost/46301] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37353 2023-07-16 22:10:52,071 INFO [Listener at localhost/46301] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 22:10:52,080 INFO [Listener at localhost/46301] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 22:10:52,081 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,083 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,086 INFO [Listener at localhost/46301] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37353 connecting to ZooKeeper ensemble=127.0.0.1:58223 2023-07-16 22:10:52,091 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:373530x0, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 22:10:52,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37353-0x101703023b70001 connected 2023-07-16 22:10:52,092 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:10:52,094 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:10:52,095 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 22:10:52,099 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37353 2023-07-16 22:10:52,099 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37353 2023-07-16 22:10:52,104 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37353 2023-07-16 22:10:52,113 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37353 2023-07-16 22:10:52,113 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37353 2023-07-16 22:10:52,129 INFO [Listener at localhost/46301] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 22:10:52,129 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,129 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,130 INFO [Listener at localhost/46301] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 22:10:52,130 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,130 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 22:10:52,130 INFO [Listener at localhost/46301] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 22:10:52,132 INFO [Listener at localhost/46301] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41119 2023-07-16 22:10:52,132 INFO [Listener at localhost/46301] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 22:10:52,135 INFO [Listener at localhost/46301] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 22:10:52,136 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,138 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,141 INFO [Listener at localhost/46301] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41119 connecting to ZooKeeper ensemble=127.0.0.1:58223 2023-07-16 22:10:52,145 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:411190x0, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 22:10:52,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41119-0x101703023b70002 connected 2023-07-16 22:10:52,147 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:10:52,148 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:10:52,148 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 22:10:52,151 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41119 2023-07-16 22:10:52,153 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41119 2023-07-16 22:10:52,155 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41119 2023-07-16 22:10:52,156 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41119 2023-07-16 22:10:52,156 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41119 2023-07-16 22:10:52,170 INFO [Listener at localhost/46301] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 22:10:52,170 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,170 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,171 INFO [Listener at localhost/46301] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 22:10:52,171 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 22:10:52,171 INFO [Listener at localhost/46301] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 22:10:52,171 INFO [Listener at localhost/46301] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 22:10:52,173 INFO [Listener at localhost/46301] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38577 2023-07-16 22:10:52,174 INFO [Listener at localhost/46301] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 22:10:52,176 INFO [Listener at localhost/46301] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 22:10:52,177 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,179 INFO [Listener at localhost/46301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,180 INFO [Listener at localhost/46301] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38577 connecting to ZooKeeper ensemble=127.0.0.1:58223 2023-07-16 22:10:52,190 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:385770x0, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 22:10:52,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38577-0x101703023b70003 connected 2023-07-16 22:10:52,191 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:10:52,192 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:10:52,193 DEBUG [Listener at localhost/46301] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 22:10:52,194 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38577 2023-07-16 22:10:52,195 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38577 2023-07-16 22:10:52,196 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38577 2023-07-16 22:10:52,199 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38577 2023-07-16 22:10:52,200 DEBUG [Listener at localhost/46301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38577 2023-07-16 22:10:52,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:10:52,214 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 22:10:52,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:10:52,239 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 22:10:52,242 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 22:10:52,243 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 22:10:52,244 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 22:10:52,244 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:52,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 22:10:52,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35007,1689545450581 from backup master directory 2023-07-16 22:10:52,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 22:10:52,252 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:10:52,252 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 22:10:52,253 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 22:10:52,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:10:52,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-16 22:10:52,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-16 22:10:52,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/hbase.id with ID: 0d2fff36-ad3d-44cb-bd18-e262e2d3fe3f 2023-07-16 22:10:52,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 22:10:52,460 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:52,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x09ffcd75 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:52,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43488974, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:52,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:10:52,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-16 22:10:52,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-16 22:10:52,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-16 22:10:52,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 22:10:52,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 22:10:52,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:52,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store-tmp 2023-07-16 22:10:52,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:52,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 22:10:52,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:10:52,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:10:52,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 22:10:52,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:10:52,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:10:52,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 22:10:52,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/WALs/jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:10:52,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35007%2C1689545450581, suffix=, logDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/WALs/jenkins-hbase4.apache.org,35007,1689545450581, archiveDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/oldWALs, maxLogs=10 2023-07-16 22:10:52,904 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK] 2023-07-16 22:10:52,904 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK] 2023-07-16 22:10:52,904 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK] 2023-07-16 22:10:52,912 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-16 22:10:52,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/WALs/jenkins-hbase4.apache.org,35007,1689545450581/jenkins-hbase4.apache.org%2C35007%2C1689545450581.1689545452842 2023-07-16 22:10:52,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK], DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK], DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK]] 2023-07-16 22:10:53,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:10:53,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:53,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,089 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,103 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-16 22:10:53,138 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-16 22:10:53,155 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:53,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 22:10:53,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:10:53,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70773982, jitterRate=0.054614514112472534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:10:53,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 22:10:53,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-16 22:10:53,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-16 22:10:53,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-16 22:10:53,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-16 22:10:53,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-16 22:10:53,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-16 22:10:53,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-16 22:10:53,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-16 22:10:53,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-16 22:10:53,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-16 22:10:53,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-16 22:10:53,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-16 22:10:53,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-16 22:10:53,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-16 22:10:53,375 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:53,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-16 22:10:53,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-16 22:10:53,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-16 22:10:53,409 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 22:10:53,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 22:10:53,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 22:10:53,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 22:10:53,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:53,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35007,1689545450581, sessionid=0x101703023b70000, setting cluster-up flag (Was=false) 2023-07-16 22:10:53,435 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:53,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-16 22:10:53,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:10:53,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:53,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-16 22:10:53,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:10:53,463 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp 2023-07-16 22:10:53,507 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(951): ClusterId : 0d2fff36-ad3d-44cb-bd18-e262e2d3fe3f 2023-07-16 22:10:53,510 INFO [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(951): ClusterId : 0d2fff36-ad3d-44cb-bd18-e262e2d3fe3f 2023-07-16 22:10:53,511 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(951): ClusterId : 0d2fff36-ad3d-44cb-bd18-e262e2d3fe3f 2023-07-16 22:10:53,516 DEBUG [RS:0;jenkins-hbase4:37353] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 22:10:53,516 DEBUG [RS:2;jenkins-hbase4:38577] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 22:10:53,516 DEBUG [RS:1;jenkins-hbase4:41119] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 22:10:53,523 DEBUG [RS:0;jenkins-hbase4:37353] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 22:10:53,523 DEBUG [RS:1;jenkins-hbase4:41119] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 22:10:53,523 DEBUG [RS:2;jenkins-hbase4:38577] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 22:10:53,523 DEBUG [RS:1;jenkins-hbase4:41119] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 22:10:53,523 DEBUG [RS:0;jenkins-hbase4:37353] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 22:10:53,524 DEBUG [RS:2;jenkins-hbase4:38577] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 22:10:53,529 DEBUG [RS:2;jenkins-hbase4:38577] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 22:10:53,529 DEBUG [RS:0;jenkins-hbase4:37353] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 22:10:53,529 DEBUG [RS:1;jenkins-hbase4:41119] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 22:10:53,536 DEBUG [RS:2;jenkins-hbase4:38577] zookeeper.ReadOnlyZKClient(139): Connect 0x528fe738 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:53,537 DEBUG [RS:0;jenkins-hbase4:37353] zookeeper.ReadOnlyZKClient(139): Connect 0x77f88667 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:53,537 DEBUG [RS:1;jenkins-hbase4:41119] zookeeper.ReadOnlyZKClient(139): Connect 0x26cc8938 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:53,577 DEBUG [RS:1;jenkins-hbase4:41119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7edc8322, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:53,578 DEBUG [RS:0;jenkins-hbase4:37353] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d1d10e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:53,578 DEBUG [RS:1;jenkins-hbase4:41119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3efaf26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 22:10:53,579 DEBUG [RS:2;jenkins-hbase4:38577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@178d730d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:53,579 DEBUG [RS:0;jenkins-hbase4:37353] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fda063a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 22:10:53,579 DEBUG [RS:2;jenkins-hbase4:38577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@737cb878, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 22:10:53,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-16 22:10:53,612 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37353 2023-07-16 22:10:53,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:53,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-16 22:10:53,620 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:38577 2023-07-16 22:10:53,623 INFO [RS:0;jenkins-hbase4:37353] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 22:10:53,623 INFO [RS:0;jenkins-hbase4:37353] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 22:10:53,624 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 22:10:53,623 INFO [RS:2;jenkins-hbase4:38577] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 22:10:53,630 INFO [RS:2;jenkins-hbase4:38577] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 22:10:53,630 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 22:10:53,627 INFO [RS:0;jenkins-hbase4:37353] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:53,630 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 22:10:53,631 INFO [RS:2;jenkins-hbase4:38577] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:53,631 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 22:10:53,634 INFO [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35007,1689545450581 with isa=jenkins-hbase4.apache.org/172.31.14.131:37353, startcode=1689545452057 2023-07-16 22:10:53,644 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35007,1689545450581 with isa=jenkins-hbase4.apache.org/172.31.14.131:38577, startcode=1689545452169 2023-07-16 22:10:53,659 DEBUG [RS:0;jenkins-hbase4:37353] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 22:10:53,659 DEBUG [RS:2;jenkins-hbase4:38577] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 22:10:53,668 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41119 2023-07-16 22:10:53,668 INFO [RS:1;jenkins-hbase4:41119] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 22:10:53,668 INFO [RS:1;jenkins-hbase4:41119] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 22:10:53,668 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 22:10:53,668 INFO [RS:1;jenkins-hbase4:41119] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:53,669 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 22:10:53,670 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35007,1689545450581 with isa=jenkins-hbase4.apache.org/172.31.14.131:41119, startcode=1689545452128 2023-07-16 22:10:53,670 DEBUG [RS:1;jenkins-hbase4:41119] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 22:10:53,741 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53223, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 22:10:53,742 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42039, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 22:10:53,741 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46255, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 22:10:53,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-16 22:10:53,753 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35007] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 22:10:53,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 22:10:53,765 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35007] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 22:10:53,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 22:10:53,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 22:10:53,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 22:10:53,766 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35007] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 22:10:53,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-16 22:10:53,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:53,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 22:10:53,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:53,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689545483784 2023-07-16 22:10:53,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-16 22:10:53,790 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 22:10:53,790 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 22:10:53,790 WARN [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 22:10:53,790 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 22:10:53,791 WARN [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 22:10:53,790 WARN [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 22:10:53,793 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 22:10:53,794 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-16 22:10:53,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-16 22:10:53,799 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 22:10:53,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-16 22:10:53,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-16 22:10:53,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-16 22:10:53,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-16 22:10:53,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:53,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-16 22:10:53,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-16 22:10:53,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-16 22:10:53,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-16 22:10:53,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-16 22:10:53,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689545453821,5,FailOnTimeoutGroup] 2023-07-16 22:10:53,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689545453821,5,FailOnTimeoutGroup] 2023-07-16 22:10:53,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:53,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-16 22:10:53,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:53,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:53,864 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 22:10:53,866 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 22:10:53,866 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:10:53,893 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35007,1689545450581 with isa=jenkins-hbase4.apache.org/172.31.14.131:41119, startcode=1689545452128 2023-07-16 22:10:53,893 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35007,1689545450581 with isa=jenkins-hbase4.apache.org/172.31.14.131:38577, startcode=1689545452169 2023-07-16 22:10:53,895 INFO [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35007,1689545450581 with isa=jenkins-hbase4.apache.org/172.31.14.131:37353, startcode=1689545452057 2023-07-16 22:10:53,908 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35007] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:53,913 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:53,916 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35007] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:53,916 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35007] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:10:53,917 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:10:53,918 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38033 2023-07-16 22:10:53,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 22:10:53,918 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 22:10:53,919 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:10:53,919 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:10:53,919 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38033 2023-07-16 22:10:53,919 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38033 2023-07-16 22:10:53,919 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 22:10:53,919 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 22:10:53,922 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/info 2023-07-16 22:10:53,924 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 22:10:53,925 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:53,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 22:10:53,926 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:10:53,931 DEBUG [RS:2;jenkins-hbase4:38577] zookeeper.ZKUtil(162): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:53,931 WARN [RS:2;jenkins-hbase4:38577] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 22:10:53,931 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/rep_barrier 2023-07-16 22:10:53,932 DEBUG [RS:0;jenkins-hbase4:37353] zookeeper.ZKUtil(162): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:10:53,931 INFO [RS:2;jenkins-hbase4:38577] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:53,932 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:53,932 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 22:10:53,932 DEBUG [RS:1;jenkins-hbase4:41119] zookeeper.ZKUtil(162): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:53,932 WARN [RS:0;jenkins-hbase4:37353] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 22:10:53,933 WARN [RS:1;jenkins-hbase4:41119] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 22:10:53,935 INFO [RS:0;jenkins-hbase4:37353] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:53,935 INFO [RS:1;jenkins-hbase4:41119] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:53,935 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:10:53,935 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:53,939 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:53,939 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38577,1689545452169] 2023-07-16 22:10:53,939 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41119,1689545452128] 2023-07-16 22:10:53,939 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37353,1689545452057] 2023-07-16 22:10:53,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 22:10:53,950 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/table 2023-07-16 22:10:53,954 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 22:10:53,955 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:53,959 DEBUG [RS:2;jenkins-hbase4:38577] zookeeper.ZKUtil(162): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:53,964 DEBUG [RS:2;jenkins-hbase4:38577] zookeeper.ZKUtil(162): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:53,965 DEBUG [RS:2;jenkins-hbase4:38577] zookeeper.ZKUtil(162): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:10:53,966 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740 2023-07-16 22:10:53,966 DEBUG [RS:1;jenkins-hbase4:41119] zookeeper.ZKUtil(162): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:53,971 DEBUG [RS:1;jenkins-hbase4:41119] zookeeper.ZKUtil(162): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:53,971 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740 2023-07-16 22:10:53,972 DEBUG [RS:1;jenkins-hbase4:41119] zookeeper.ZKUtil(162): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:10:53,973 DEBUG [RS:0;jenkins-hbase4:37353] zookeeper.ZKUtil(162): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:53,974 DEBUG [RS:0;jenkins-hbase4:37353] zookeeper.ZKUtil(162): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:53,975 DEBUG [RS:0;jenkins-hbase4:37353] zookeeper.ZKUtil(162): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:10:53,977 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 22:10:53,980 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 22:10:53,982 DEBUG [RS:0;jenkins-hbase4:37353] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 22:10:53,982 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 22:10:53,982 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 22:10:53,996 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:10:53,997 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65202739, jitterRate=-0.028403475880622864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 22:10:53,998 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 22:10:53,998 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 22:10:53,998 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 22:10:53,998 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 22:10:53,998 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 22:10:53,998 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 22:10:53,999 INFO [RS:0;jenkins-hbase4:37353] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 22:10:54,000 INFO [RS:2;jenkins-hbase4:38577] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 22:10:54,000 INFO [RS:1;jenkins-hbase4:41119] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 22:10:54,008 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 22:10:54,008 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 22:10:54,027 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 22:10:54,027 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-16 22:10:54,045 INFO [RS:0;jenkins-hbase4:37353] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 22:10:54,045 INFO [RS:1;jenkins-hbase4:41119] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 22:10:54,045 INFO [RS:2;jenkins-hbase4:38577] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 22:10:54,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-16 22:10:54,058 INFO [RS:0;jenkins-hbase4:37353] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 22:10:54,058 INFO [RS:2;jenkins-hbase4:38577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 22:10:54,059 INFO [RS:0;jenkins-hbase4:37353] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,058 INFO [RS:1;jenkins-hbase4:41119] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 22:10:54,059 INFO [RS:2;jenkins-hbase4:38577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,060 INFO [RS:1;jenkins-hbase4:41119] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,060 INFO [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 22:10:54,062 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 22:10:54,070 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 22:10:54,075 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-16 22:10:54,077 INFO [RS:1;jenkins-hbase4:41119] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,077 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,077 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,077 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,078 INFO [RS:0;jenkins-hbase4:37353] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,079 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,078 INFO [RS:2;jenkins-hbase4:38577] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,080 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,081 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,080 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,081 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,081 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 22:10:54,081 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,081 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,081 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,081 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,081 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 22:10:54,081 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,081 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,079 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:2;jenkins-hbase4:38577] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:1;jenkins-hbase4:41119] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,082 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 22:10:54,083 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,083 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,083 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,083 DEBUG [RS:0;jenkins-hbase4:37353] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 22:10:54,084 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-16 22:10:54,123 INFO [RS:0;jenkins-hbase4:37353] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,123 INFO [RS:0;jenkins-hbase4:37353] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,124 INFO [RS:0;jenkins-hbase4:37353] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,126 INFO [RS:2;jenkins-hbase4:38577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,127 INFO [RS:2;jenkins-hbase4:38577] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,127 INFO [RS:2;jenkins-hbase4:38577] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,146 INFO [RS:1;jenkins-hbase4:41119] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,147 INFO [RS:1;jenkins-hbase4:41119] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,147 INFO [RS:1;jenkins-hbase4:41119] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,158 INFO [RS:0;jenkins-hbase4:37353] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 22:10:54,162 INFO [RS:0;jenkins-hbase4:37353] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37353,1689545452057-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,162 INFO [RS:2;jenkins-hbase4:38577] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 22:10:54,163 INFO [RS:2;jenkins-hbase4:38577] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38577,1689545452169-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,173 INFO [RS:1;jenkins-hbase4:41119] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 22:10:54,173 INFO [RS:1;jenkins-hbase4:41119] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41119,1689545452128-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,201 INFO [RS:0;jenkins-hbase4:37353] regionserver.Replication(203): jenkins-hbase4.apache.org,37353,1689545452057 started 2023-07-16 22:10:54,201 INFO [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37353,1689545452057, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37353, sessionid=0x101703023b70001 2023-07-16 22:10:54,202 DEBUG [RS:0;jenkins-hbase4:37353] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 22:10:54,202 DEBUG [RS:0;jenkins-hbase4:37353] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:10:54,202 DEBUG [RS:0;jenkins-hbase4:37353] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37353,1689545452057' 2023-07-16 22:10:54,202 DEBUG [RS:0;jenkins-hbase4:37353] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 22:10:54,203 DEBUG [RS:0;jenkins-hbase4:37353] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 22:10:54,204 DEBUG [RS:0;jenkins-hbase4:37353] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 22:10:54,204 DEBUG [RS:0;jenkins-hbase4:37353] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 22:10:54,204 DEBUG [RS:0;jenkins-hbase4:37353] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:10:54,204 DEBUG [RS:0;jenkins-hbase4:37353] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37353,1689545452057' 2023-07-16 22:10:54,204 DEBUG [RS:0;jenkins-hbase4:37353] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:10:54,205 DEBUG [RS:0;jenkins-hbase4:37353] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:10:54,205 DEBUG [RS:0;jenkins-hbase4:37353] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 22:10:54,206 INFO [RS:0;jenkins-hbase4:37353] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 22:10:54,206 INFO [RS:0;jenkins-hbase4:37353] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 22:10:54,225 INFO [RS:2;jenkins-hbase4:38577] regionserver.Replication(203): jenkins-hbase4.apache.org,38577,1689545452169 started 2023-07-16 22:10:54,225 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38577,1689545452169, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38577, sessionid=0x101703023b70003 2023-07-16 22:10:54,226 INFO [RS:1;jenkins-hbase4:41119] regionserver.Replication(203): jenkins-hbase4.apache.org,41119,1689545452128 started 2023-07-16 22:10:54,226 DEBUG [RS:2;jenkins-hbase4:38577] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 22:10:54,226 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41119,1689545452128, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41119, sessionid=0x101703023b70002 2023-07-16 22:10:54,226 DEBUG [RS:2;jenkins-hbase4:38577] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:54,227 DEBUG [RS:1;jenkins-hbase4:41119] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 22:10:54,228 DEBUG [RS:1;jenkins-hbase4:41119] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:54,227 DEBUG [RS:2;jenkins-hbase4:38577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38577,1689545452169' 2023-07-16 22:10:54,228 DEBUG [RS:2;jenkins-hbase4:38577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 22:10:54,228 DEBUG [RS:1;jenkins-hbase4:41119] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41119,1689545452128' 2023-07-16 22:10:54,228 DEBUG [RS:1;jenkins-hbase4:41119] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 22:10:54,228 DEBUG [RS:2;jenkins-hbase4:38577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 22:10:54,229 DEBUG [RS:1;jenkins-hbase4:41119] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 22:10:54,229 DEBUG [RS:2;jenkins-hbase4:38577] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 22:10:54,229 DEBUG [RS:2;jenkins-hbase4:38577] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 22:10:54,229 DEBUG [RS:2;jenkins-hbase4:38577] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:54,230 DEBUG [RS:2;jenkins-hbase4:38577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38577,1689545452169' 2023-07-16 22:10:54,230 DEBUG [RS:2;jenkins-hbase4:38577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:10:54,230 DEBUG [RS:1;jenkins-hbase4:41119] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 22:10:54,230 DEBUG [RS:1;jenkins-hbase4:41119] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 22:10:54,230 DEBUG [RS:1;jenkins-hbase4:41119] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:54,230 DEBUG [RS:1;jenkins-hbase4:41119] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41119,1689545452128' 2023-07-16 22:10:54,230 DEBUG [RS:1;jenkins-hbase4:41119] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:10:54,230 DEBUG [RS:2;jenkins-hbase4:38577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:10:54,231 DEBUG [RS:1;jenkins-hbase4:41119] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:10:54,231 DEBUG [RS:2;jenkins-hbase4:38577] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 22:10:54,231 INFO [RS:2;jenkins-hbase4:38577] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 22:10:54,232 INFO [RS:2;jenkins-hbase4:38577] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 22:10:54,233 DEBUG [RS:1;jenkins-hbase4:41119] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 22:10:54,233 INFO [RS:1;jenkins-hbase4:41119] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 22:10:54,233 INFO [RS:1;jenkins-hbase4:41119] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 22:10:54,247 DEBUG [jenkins-hbase4:35007] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-16 22:10:54,252 DEBUG [jenkins-hbase4:35007] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:10:54,259 DEBUG [jenkins-hbase4:35007] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:10:54,259 DEBUG [jenkins-hbase4:35007] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:10:54,259 DEBUG [jenkins-hbase4:35007] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:10:54,259 DEBUG [jenkins-hbase4:35007] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:10:54,262 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41119,1689545452128, state=OPENING 2023-07-16 22:10:54,274 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-16 22:10:54,275 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:54,276 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 22:10:54,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:10:54,319 INFO [RS:0;jenkins-hbase4:37353] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37353%2C1689545452057, suffix=, logDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,37353,1689545452057, archiveDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/oldWALs, maxLogs=32 2023-07-16 22:10:54,340 INFO [RS:2;jenkins-hbase4:38577] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38577%2C1689545452169, suffix=, logDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,38577,1689545452169, archiveDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/oldWALs, maxLogs=32 2023-07-16 22:10:54,344 INFO [RS:1;jenkins-hbase4:41119] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41119%2C1689545452128, suffix=, logDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,41119,1689545452128, archiveDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/oldWALs, maxLogs=32 2023-07-16 22:10:54,370 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK] 2023-07-16 22:10:54,371 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK] 2023-07-16 22:10:54,373 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK] 2023-07-16 22:10:54,424 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK] 2023-07-16 22:10:54,424 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK] 2023-07-16 22:10:54,425 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK] 2023-07-16 22:10:54,426 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK] 2023-07-16 22:10:54,426 INFO [RS:0;jenkins-hbase4:37353] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,37353,1689545452057/jenkins-hbase4.apache.org%2C37353%2C1689545452057.1689545454322 2023-07-16 22:10:54,435 DEBUG [RS:0;jenkins-hbase4:37353] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK], DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK], DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK]] 2023-07-16 22:10:54,435 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK] 2023-07-16 22:10:54,435 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK] 2023-07-16 22:10:54,460 INFO [RS:2;jenkins-hbase4:38577] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,38577,1689545452169/jenkins-hbase4.apache.org%2C38577%2C1689545452169.1689545454342 2023-07-16 22:10:54,460 INFO [RS:1;jenkins-hbase4:41119] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,41119,1689545452128/jenkins-hbase4.apache.org%2C41119%2C1689545452128.1689545454346 2023-07-16 22:10:54,470 DEBUG [RS:2;jenkins-hbase4:38577] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK], DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK], DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK]] 2023-07-16 22:10:54,486 DEBUG [RS:1;jenkins-hbase4:41119] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK], DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK], DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK]] 2023-07-16 22:10:54,497 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:54,501 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:10:54,512 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:10:54,540 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-16 22:10:54,540 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 22:10:54,544 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41119%2C1689545452128.meta, suffix=.meta, logDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,41119,1689545452128, archiveDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/oldWALs, maxLogs=32 2023-07-16 22:10:54,583 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK] 2023-07-16 22:10:54,583 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK] 2023-07-16 22:10:54,583 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK] 2023-07-16 22:10:54,611 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/WALs/jenkins-hbase4.apache.org,41119,1689545452128/jenkins-hbase4.apache.org%2C41119%2C1689545452128.meta.1689545454546.meta 2023-07-16 22:10:54,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38565,DS-8687eb49-26da-478b-984a-01e90d24d631,DISK], DatanodeInfoWithStorage[127.0.0.1:40069,DS-90d9b519-108f-4a4c-8518-f0dc1436a4dd,DISK], DatanodeInfoWithStorage[127.0.0.1:35503,DS-93c8f9fb-c04b-4343-a4a8-6e67c07a9429,DISK]] 2023-07-16 22:10:54,615 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:10:54,616 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-16 22:10:54,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:54,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-16 22:10:54,620 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-16 22:10:54,622 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-16 22:10:54,638 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-16 22:10:54,638 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:54,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-16 22:10:54,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-16 22:10:54,648 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 22:10:54,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/info 2023-07-16 22:10:54,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/info 2023-07-16 22:10:54,652 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 22:10:54,653 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:54,653 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 22:10:54,659 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/rep_barrier 2023-07-16 22:10:54,659 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/rep_barrier 2023-07-16 22:10:54,659 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 22:10:54,661 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:54,661 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 22:10:54,663 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/table 2023-07-16 22:10:54,663 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/table 2023-07-16 22:10:54,663 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 22:10:54,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:54,667 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740 2023-07-16 22:10:54,670 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740 2023-07-16 22:10:54,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 22:10:54,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 22:10:54,681 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60059680, jitterRate=-0.1050410270690918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 22:10:54,684 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 22:10:54,698 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689545454475 2023-07-16 22:10:54,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-16 22:10:54,732 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-16 22:10:54,736 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41119,1689545452128, state=OPEN 2023-07-16 22:10:54,740 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-16 22:10:54,741 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 22:10:54,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-16 22:10:54,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41119,1689545452128 in 458 msec 2023-07-16 22:10:54,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-16 22:10:54,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 704 msec 2023-07-16 22:10:54,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1340 sec 2023-07-16 22:10:54,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689545454759, completionTime=-1 2023-07-16 22:10:54,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-16 22:10:54,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-16 22:10:54,840 DEBUG [hconnection-0x6b642fce-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:10:54,842 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:10:54,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-16 22:10:54,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689545514865 2023-07-16 22:10:54,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689545574865 2023-07-16 22:10:54,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 105 msec 2023-07-16 22:10:54,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35007,1689545450581-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35007,1689545450581-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35007,1689545450581-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35007, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-16 22:10:54,908 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-16 22:10:54,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-16 22:10:54,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 22:10:54,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-16 22:10:54,929 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:10:54,933 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:10:54,975 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:54,980 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1 empty. 2023-07-16 22:10:54,981 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:54,981 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-16 22:10:55,033 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-16 22:10:55,039 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => f2cbbf37e8c21240601e65766913f0f1, NAME => 'hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:10:55,072 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:55,072 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing f2cbbf37e8c21240601e65766913f0f1, disabling compactions & flushes 2023-07-16 22:10:55,072 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:10:55,072 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:10:55,072 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. after waiting 0 ms 2023-07-16 22:10:55,073 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:10:55,073 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:10:55,073 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for f2cbbf37e8c21240601e65766913f0f1: 2023-07-16 22:10:55,078 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:10:55,097 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689545455081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545455081"}]},"ts":"1689545455081"} 2023-07-16 22:10:55,134 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 22:10:55,136 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:10:55,140 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545455136"}]},"ts":"1689545455136"} 2023-07-16 22:10:55,146 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-16 22:10:55,153 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:10:55,154 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:10:55,154 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:10:55,154 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:10:55,155 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:10:55,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f2cbbf37e8c21240601e65766913f0f1, ASSIGN}] 2023-07-16 22:10:55,161 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f2cbbf37e8c21240601e65766913f0f1, ASSIGN 2023-07-16 22:10:55,165 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f2cbbf37e8c21240601e65766913f0f1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41119,1689545452128; forceNewPlan=false, retain=false 2023-07-16 22:10:55,318 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 22:10:55,319 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f2cbbf37e8c21240601e65766913f0f1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:55,319 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689545455319"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545455319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545455319"}]},"ts":"1689545455319"} 2023-07-16 22:10:55,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f2cbbf37e8c21240601e65766913f0f1, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:10:55,489 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:10:55,489 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2cbbf37e8c21240601e65766913f0f1, NAME => 'hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1.', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:10:55,489 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. service=AccessControlService 2023-07-16 22:10:55,490 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:55,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:55,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:55,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:55,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:55,495 INFO [StoreOpener-f2cbbf37e8c21240601e65766913f0f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:55,497 DEBUG [StoreOpener-f2cbbf37e8c21240601e65766913f0f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1/info 2023-07-16 22:10:55,497 DEBUG [StoreOpener-f2cbbf37e8c21240601e65766913f0f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1/info 2023-07-16 22:10:55,498 INFO [StoreOpener-f2cbbf37e8c21240601e65766913f0f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2cbbf37e8c21240601e65766913f0f1 columnFamilyName info 2023-07-16 22:10:55,499 INFO [StoreOpener-f2cbbf37e8c21240601e65766913f0f1-1] regionserver.HStore(310): Store=f2cbbf37e8c21240601e65766913f0f1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:55,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:55,508 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:55,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:10:55,521 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:10:55,522 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2cbbf37e8c21240601e65766913f0f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61990643, jitterRate=-0.07626743614673615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:10:55,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2cbbf37e8c21240601e65766913f0f1: 2023-07-16 22:10:55,525 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1., pid=6, masterSystemTime=1689545455480 2023-07-16 22:10:55,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:10:55,529 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:10:55,531 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f2cbbf37e8c21240601e65766913f0f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:10:55,532 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689545455531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545455531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545455531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545455531"}]},"ts":"1689545455531"} 2023-07-16 22:10:55,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-16 22:10:55,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f2cbbf37e8c21240601e65766913f0f1, server=jenkins-hbase4.apache.org,41119,1689545452128 in 209 msec 2023-07-16 22:10:55,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-16 22:10:55,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f2cbbf37e8c21240601e65766913f0f1, ASSIGN in 381 msec 2023-07-16 22:10:55,544 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:10:55,545 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545455545"}]},"ts":"1689545455545"} 2023-07-16 22:10:55,547 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-16 22:10:55,551 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:10:55,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 636 msec 2023-07-16 22:10:55,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-16 22:10:55,632 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-16 22:10:55,632 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:10:55,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-16 22:10:55,695 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 22:10:55,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-07-16 22:10:55,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-16 22:10:55,725 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 22:10:55,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-16 22:10:55,747 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 22:10:55,749 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-16 22:10:55,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.497sec 2023-07-16 22:10:55,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-16 22:10:55,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-16 22:10:55,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-16 22:10:55,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35007,1689545450581-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-16 22:10:55,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35007,1689545450581-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-16 22:10:55,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 22:10:55,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-16 22:10:55,784 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:10:55,786 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:10:55,788 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:55,789 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45 empty. 2023-07-16 22:10:55,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-16 22:10:55,792 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:55,792 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-16 22:10:55,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 22:10:55,822 DEBUG [Listener at localhost/46301] zookeeper.ReadOnlyZKClient(139): Connect 0x722ff5ad to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:10:55,827 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-16 22:10:55,833 DEBUG [Listener at localhost/46301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37ed2880, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:10:55,835 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a3c7c834823bb54b459e196aec7c7c45, NAME => 'hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:10:55,854 DEBUG [hconnection-0x8d80b2c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:10:55,880 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:10:55,887 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:55,888 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a3c7c834823bb54b459e196aec7c7c45, disabling compactions & flushes 2023-07-16 22:10:55,888 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:10:55,888 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:10:55,888 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. after waiting 0 ms 2023-07-16 22:10:55,888 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:10:55,888 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:10:55,888 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-16 22:10:55,888 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:10:55,888 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/test.cache.data in system properties and HBase conf 2023-07-16 22:10:55,888 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a3c7c834823bb54b459e196aec7c7c45: 2023-07-16 22:10:55,889 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 22:10:55,889 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop.log.dir in system properties and HBase conf 2023-07-16 22:10:55,889 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 22:10:55,889 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 22:10:55,889 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 22:10:55,890 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 22:10:55,890 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 22:10:55,890 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 22:10:55,890 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 22:10:55,890 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 22:10:55,890 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 22:10:55,891 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 22:10:55,891 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 22:10:55,891 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 22:10:55,891 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/nfs.dump.dir in system properties and HBase conf 2023-07-16 22:10:55,891 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir in system properties and HBase conf 2023-07-16 22:10:55,891 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 22:10:55,891 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 22:10:55,891 INFO [Listener at localhost/46301] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-16 22:10:55,894 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:10:55,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689545455896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545455896"}]},"ts":"1689545455896"} 2023-07-16 22:10:55,900 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 22:10:55,901 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:10:55,901 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545455901"}]},"ts":"1689545455901"} 2023-07-16 22:10:55,904 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-16 22:10:55,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 22:10:55,914 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:10:55,915 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:10:55,915 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:10:55,915 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:10:55,915 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:10:55,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a3c7c834823bb54b459e196aec7c7c45, ASSIGN}] 2023-07-16 22:10:55,920 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a3c7c834823bb54b459e196aec7c7c45, ASSIGN 2023-07-16 22:10:55,923 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a3c7c834823bb54b459e196aec7c7c45, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38577,1689545452169; forceNewPlan=false, retain=false 2023-07-16 22:10:56,074 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 22:10:56,075 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a3c7c834823bb54b459e196aec7c7c45, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:56,076 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689545456075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545456075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545456075"}]},"ts":"1689545456075"} 2023-07-16 22:10:56,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a3c7c834823bb54b459e196aec7c7c45, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:10:56,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 22:10:56,234 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:56,235 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:10:56,240 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:10:56,246 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:10:56,247 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3c7c834823bb54b459e196aec7c7c45, NAME => 'hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45.', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:10:56,247 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. service=AccessControlService 2023-07-16 22:10:56,247 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:10:56,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:56,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:10:56,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:56,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:56,251 INFO [StoreOpener-a3c7c834823bb54b459e196aec7c7c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:56,253 DEBUG [StoreOpener-a3c7c834823bb54b459e196aec7c7c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45/l 2023-07-16 22:10:56,253 DEBUG [StoreOpener-a3c7c834823bb54b459e196aec7c7c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45/l 2023-07-16 22:10:56,254 INFO [StoreOpener-a3c7c834823bb54b459e196aec7c7c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3c7c834823bb54b459e196aec7c7c45 columnFamilyName l 2023-07-16 22:10:56,255 INFO [StoreOpener-a3c7c834823bb54b459e196aec7c7c45-1] regionserver.HStore(310): Store=a3c7c834823bb54b459e196aec7c7c45/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:10:56,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:56,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:56,263 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:10:56,268 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:10:56,269 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a3c7c834823bb54b459e196aec7c7c45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73615995, jitterRate=0.0969638079404831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:10:56,270 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a3c7c834823bb54b459e196aec7c7c45: 2023-07-16 22:10:56,276 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45., pid=11, masterSystemTime=1689545456234 2023-07-16 22:10:56,281 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:10:56,282 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:10:56,283 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a3c7c834823bb54b459e196aec7c7c45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:10:56,283 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689545456283"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545456283"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545456283"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545456283"}]},"ts":"1689545456283"} 2023-07-16 22:10:56,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-16 22:10:56,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a3c7c834823bb54b459e196aec7c7c45, server=jenkins-hbase4.apache.org,38577,1689545452169 in 207 msec 2023-07-16 22:10:56,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-16 22:10:56,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a3c7c834823bb54b459e196aec7c7c45, ASSIGN in 377 msec 2023-07-16 22:10:56,297 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:10:56,297 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545456297"}]},"ts":"1689545456297"} 2023-07-16 22:10:56,300 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-16 22:10:56,304 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:10:56,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 524 msec 2023-07-16 22:10:56,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 22:10:56,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-16 22:10:56,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-16 22:10:57,206 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:57,513 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:57,518 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43613_jobhistory____.8iex7i/webapp 2023-07-16 22:10:57,696 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-16 22:10:57,696 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-16 22:10:57,696 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 22:10:57,698 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 22:10:57,762 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:58,052 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:58,341 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-16 22:10:58,372 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43613 2023-07-16 22:10:58,710 WARN [Listener at jenkins-hbase4.apache.org/34551] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:10:59,143 WARN [Listener at jenkins-hbase4.apache.org/34551] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 22:10:59,144 INFO [Listener at jenkins-hbase4.apache.org/34551] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:10:59,173 INFO [Listener at jenkins-hbase4.apache.org/34551] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37009_cluster____qyo8bz/webapp 2023-07-16 22:10:59,253 INFO [Listener at jenkins-hbase4.apache.org/34551] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 22:10:59,253 INFO [Listener at jenkins-hbase4.apache.org/34551] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-16 22:10:59,253 INFO [Listener at jenkins-hbase4.apache.org/34551] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 22:10:59,258 INFO [Listener at jenkins-hbase4.apache.org/34551] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 22:10:59,270 INFO [Listener at jenkins-hbase4.apache.org/34551] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:59,529 INFO [Listener at jenkins-hbase4.apache.org/34551] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:59,646 INFO [Listener at jenkins-hbase4.apache.org/34551] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:10:59,683 INFO [Listener at jenkins-hbase4.apache.org/34551] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37009 2023-07-16 22:11:00,283 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:11:00,403 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-16 22:11:00,405 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-16 22:11:00,406 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-16 22:11:00,635 WARN [Listener at jenkins-hbase4.apache.org/39317] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:11:00,665 WARN [Listener at jenkins-hbase4.apache.org/39317] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 22:11:00,666 INFO [Listener at jenkins-hbase4.apache.org/39317] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:11:00,673 INFO [Listener at jenkins-hbase4.apache.org/39317] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39825_node____wcywer/webapp 2023-07-16 22:11:00,746 INFO [Listener at jenkins-hbase4.apache.org/39317] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 22:11:00,746 INFO [Listener at jenkins-hbase4.apache.org/39317] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 22:11:00,746 INFO [Listener at jenkins-hbase4.apache.org/39317] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 22:11:00,747 INFO [Listener at jenkins-hbase4.apache.org/39317] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 22:11:00,757 INFO [Listener at jenkins-hbase4.apache.org/39317] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:00,761 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:00,761 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-16 22:11:00,762 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:00,762 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-16 22:11:00,762 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 22:11:00,762 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-16 22:11:00,763 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:00,763 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-16 22:11:00,763 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 22:11:00,763 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-16 22:11:00,781 INFO [Listener at jenkins-hbase4.apache.org/39317] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:00,884 INFO [Listener at jenkins-hbase4.apache.org/39317] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:00,915 INFO [Listener at jenkins-hbase4.apache.org/39317] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39825 2023-07-16 22:11:01,194 WARN [Listener at jenkins-hbase4.apache.org/36941] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 22:11:01,201 WARN [Listener at jenkins-hbase4.apache.org/36941] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 22:11:01,202 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 22:11:01,209 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37477_node____.3msnm/webapp 2023-07-16 22:11:01,283 INFO [Listener at jenkins-hbase4.apache.org/36941] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 22:11:01,284 INFO [Listener at jenkins-hbase4.apache.org/36941] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 22:11:01,284 INFO [Listener at jenkins-hbase4.apache.org/36941] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 22:11:01,284 INFO [Listener at jenkins-hbase4.apache.org/36941] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 22:11:01,294 INFO [Listener at jenkins-hbase4.apache.org/36941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:01,313 INFO [Listener at jenkins-hbase4.apache.org/36941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:01,403 INFO [Listener at jenkins-hbase4.apache.org/36941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 22:11:01,411 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37477 2023-07-16 22:11:01,441 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-16 22:11:01,442 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:01,516 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=176, AvailableMemoryMB=4635 2023-07-16 22:11:01,517 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-07-16 22:11:01,533 DEBUG [Listener at jenkins-hbase4.apache.org/36941] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-16 22:11:01,540 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-16 22:11:01,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 22:11:01,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:01,567 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:11:01,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-16 22:11:01,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:01,571 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:11:01,577 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:01,577 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:01,578 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c empty. 2023-07-16 22:11:01,578 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f empty. 2023-07-16 22:11:01,581 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:01,582 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:01,582 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 22:11:01,627 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-16 22:11:01,629 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4938e55d55c9a93b86f362e46021d63c, NAME => 'testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:11:01,629 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1e62a12b32e90dc46c071aa583c3047f, NAME => 'testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:11:01,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:01,687 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:01,688 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 1e62a12b32e90dc46c071aa583c3047f, disabling compactions & flushes 2023-07-16 22:11:01,688 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:01,688 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:01,688 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. after waiting 0 ms 2023-07-16 22:11:01,688 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:01,688 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:01,688 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 1e62a12b32e90dc46c071aa583c3047f: 2023-07-16 22:11:01,692 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:01,692 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 4938e55d55c9a93b86f362e46021d63c, disabling compactions & flushes 2023-07-16 22:11:01,692 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:01,692 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:01,692 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. after waiting 0 ms 2023-07-16 22:11:01,692 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:01,692 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:01,692 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 4938e55d55c9a93b86f362e46021d63c: 2023-07-16 22:11:01,696 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:11:01,698 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545461698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545461698"}]},"ts":"1689545461698"} 2023-07-16 22:11:01,698 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545461698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545461698"}]},"ts":"1689545461698"} 2023-07-16 22:11:01,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:11:01,755 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:11:01,756 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545461756"}]},"ts":"1689545461756"} 2023-07-16 22:11:01,759 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-16 22:11:01,765 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:11:01,767 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:11:01,767 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:11:01,767 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:11:01,767 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:11:01,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4938e55d55c9a93b86f362e46021d63c, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1e62a12b32e90dc46c071aa583c3047f, ASSIGN}] 2023-07-16 22:11:01,771 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1e62a12b32e90dc46c071aa583c3047f, ASSIGN 2023-07-16 22:11:01,771 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4938e55d55c9a93b86f362e46021d63c, ASSIGN 2023-07-16 22:11:01,773 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1e62a12b32e90dc46c071aa583c3047f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38577,1689545452169; forceNewPlan=false, retain=false 2023-07-16 22:11:01,773 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4938e55d55c9a93b86f362e46021d63c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41119,1689545452128; forceNewPlan=false, retain=false 2023-07-16 22:11:01,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:01,923 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:11:01,926 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4938e55d55c9a93b86f362e46021d63c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:01,926 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1e62a12b32e90dc46c071aa583c3047f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:01,926 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545461926"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545461926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545461926"}]},"ts":"1689545461926"} 2023-07-16 22:11:01,927 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545461926"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545461926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545461926"}]},"ts":"1689545461926"} 2023-07-16 22:11:01,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 4938e55d55c9a93b86f362e46021d63c, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:11:01,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 1e62a12b32e90dc46c071aa583c3047f, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:11:02,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:02,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4938e55d55c9a93b86f362e46021d63c, NAME => 'testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:11:02,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. service=AccessControlService 2023-07-16 22:11:02,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:02,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:02,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:02,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:02,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:02,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:02,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e62a12b32e90dc46c071aa583c3047f, NAME => 'testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:11:02,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. service=AccessControlService 2023-07-16 22:11:02,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:02,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:02,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:02,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:02,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:02,103 INFO [StoreOpener-1e62a12b32e90dc46c071aa583c3047f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:02,103 INFO [StoreOpener-4938e55d55c9a93b86f362e46021d63c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:02,105 DEBUG [StoreOpener-1e62a12b32e90dc46c071aa583c3047f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf 2023-07-16 22:11:02,105 DEBUG [StoreOpener-1e62a12b32e90dc46c071aa583c3047f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf 2023-07-16 22:11:02,105 DEBUG [StoreOpener-4938e55d55c9a93b86f362e46021d63c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf 2023-07-16 22:11:02,106 DEBUG [StoreOpener-4938e55d55c9a93b86f362e46021d63c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf 2023-07-16 22:11:02,111 INFO [StoreOpener-1e62a12b32e90dc46c071aa583c3047f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e62a12b32e90dc46c071aa583c3047f columnFamilyName cf 2023-07-16 22:11:02,111 INFO [StoreOpener-4938e55d55c9a93b86f362e46021d63c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4938e55d55c9a93b86f362e46021d63c columnFamilyName cf 2023-07-16 22:11:02,115 INFO [StoreOpener-1e62a12b32e90dc46c071aa583c3047f-1] regionserver.HStore(310): Store=1e62a12b32e90dc46c071aa583c3047f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:02,115 INFO [StoreOpener-4938e55d55c9a93b86f362e46021d63c-1] regionserver.HStore(310): Store=4938e55d55c9a93b86f362e46021d63c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:02,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:02,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:02,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:02,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:02,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:02,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:02,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:02,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e62a12b32e90dc46c071aa583c3047f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61850389, jitterRate=-0.07835738360881805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:02,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e62a12b32e90dc46c071aa583c3047f: 2023-07-16 22:11:02,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f., pid=16, masterSystemTime=1689545462086 2023-07-16 22:11:02,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:02,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:02,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:02,160 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1e62a12b32e90dc46c071aa583c3047f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:02,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545462160"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545462160"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545462160"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545462160"}]},"ts":"1689545462160"} 2023-07-16 22:11:02,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4938e55d55c9a93b86f362e46021d63c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66605793, jitterRate=-0.007496342062950134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:02,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4938e55d55c9a93b86f362e46021d63c: 2023-07-16 22:11:02,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c., pid=15, masterSystemTime=1689545462084 2023-07-16 22:11:02,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:02,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:02,167 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4938e55d55c9a93b86f362e46021d63c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:02,169 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545462167"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545462167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545462167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545462167"}]},"ts":"1689545462167"} 2023-07-16 22:11:02,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-16 22:11:02,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 1e62a12b32e90dc46c071aa583c3047f, server=jenkins-hbase4.apache.org,38577,1689545452169 in 231 msec 2023-07-16 22:11:02,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1e62a12b32e90dc46c071aa583c3047f, ASSIGN in 403 msec 2023-07-16 22:11:02,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-16 22:11:02,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 4938e55d55c9a93b86f362e46021d63c, server=jenkins-hbase4.apache.org,41119,1689545452128 in 243 msec 2023-07-16 22:11:02,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-16 22:11:02,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4938e55d55c9a93b86f362e46021d63c, ASSIGN in 410 msec 2023-07-16 22:11:02,183 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:11:02,183 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545462183"}]},"ts":"1689545462183"} 2023-07-16 22:11:02,185 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-16 22:11:02,188 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:11:02,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:02,195 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-16 22:11:02,202 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,203 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,208 DEBUG [hconnection-0x75d2cac9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,211 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,219 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 22:11:02,252 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:02,252 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:02,252 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:02,252 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:02,252 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:11:02,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:02,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:02,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:02,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:02,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 707 msec 2023-07-16 22:11:02,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 22:11:02,692 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-16 22:11:02,697 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 22:11:02,698 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:02,701 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:02,734 DEBUG [hconnection-0x8d80b2c-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,739 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:02,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545462755 (current time:1689545462755). 2023-07-16 22:11:02,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:02,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x22b3dbf4 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:02,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a5ce5a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:02,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,770 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22b3dbf4 to 127.0.0.1:58223 2023-07-16 22:11:02,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:02,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x309cdf23 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:02,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6085fd19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:02,790 DEBUG [hconnection-0x380191cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,791 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:02,801 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:02,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x309cdf23 to 127.0.0.1:58223 2023-07-16 22:11:02,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:02,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 22:11:02,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:02,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:02,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:02,857 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:02,862 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689546062862 2023-07-16 22:11:02,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:02,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 22:11:02,866 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:02,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:02,871 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:02,872 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:02,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 21 msec 2023-07-16 22:11:02,873 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:02,875 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689546062875 2023-07-16 22:11:02,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,905 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-16 22:11:02,906 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:02,907 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 22:11:02,907 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 22:11:02,908 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,908 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,911 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:02,911 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:02,911 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:02,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:02,911 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:02,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:02,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:02,912 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:02,912 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:02,913 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:02,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,913 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:02,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 22:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 22:11:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 22:11:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:02,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:02,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:02,924 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:02,929 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,930 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:02,930 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:02,931 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,931 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:02,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:02,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:02,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:02,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 22:11:02,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46753729[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:02,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:02,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:02,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:02,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 22:11:02,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46753729[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:02,938 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 22:11:02,938 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,945 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,945 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,945 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,945 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:02,945 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:02,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:02,946 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:11:02,946 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:02,956 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:02,956 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:02,956 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:02,957 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:02,956 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:02,956 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:02,957 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:02,957 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:02,957 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:02,958 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. started... 2023-07-16 22:11:02,958 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. started... 2023-07-16 22:11:02,962 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e62a12b32e90dc46c071aa583c3047f: 2023-07-16 22:11:02,962 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4938e55d55c9a93b86f362e46021d63c: 2023-07-16 22:11:02,963 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,963 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:02,969 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:02,970 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:02,972 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:02,975 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:02,975 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:02,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:02,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:02,977 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:03,021 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. completed. 2023-07-16 22:11:03,021 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:03,022 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. completed. 2023-07-16 22:11:03,022 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:11:03,022 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:11:03,024 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,024 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,024 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,025 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:03,027 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,027 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:03,027 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,027 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:03,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:11:03,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 22:11:03,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41119,1689545452128': 2023-07-16 22:11:03,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 22:11:03,044 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-16 22:11:03,044 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:03,044 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:03,044 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,044 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:03,047 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,047 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,047 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,047 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,047 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,048 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,048 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,049 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,049 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,050 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,054 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,054 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,055 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,071 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,071 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,071 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,071 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,071 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,071 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,071 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,072 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,075 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,075 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,075 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:03,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-16 22:11:03,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:11:03,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 22:11:03,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:03,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,177 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:03,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:03,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:03,180 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:11:03,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 22:11:03,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,223 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:03,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689545462864Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689545463105 (+241 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689545463105Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689545463105Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689545463125 (+20 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689545463159 (+34 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689545463222 (+63 ms) 2023-07-16 22:11:03,226 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:03,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 359 msec 2023-07-16 22:11:03,480 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:03,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:03,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:03,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41119] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:03,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38577] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:03,511 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 22:11:03,511 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:03,511 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:03,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:03,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545463531 (current time:1689545463531). 2023-07-16 22:11:03,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:03,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x395524c0 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:03,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44ff06c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:03,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:03,547 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:03,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x395524c0 to 127.0.0.1:58223 2023-07-16 22:11:03,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:03,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x376a24ec to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:03,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@278975e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:03,656 DEBUG [hconnection-0x1b7cbec0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:03,659 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:03,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:03,666 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:03,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x376a24ec to 127.0.0.1:58223 2023-07-16 22:11:03,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:03,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 22:11:03,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:03,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:03,674 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:03,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 22:11:03,675 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689546063675 2023-07-16 22:11:03,675 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 22:11:03,677 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:03,677 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:03,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:03,679 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 22:11:03,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-16 22:11:03,682 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:03,683 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689546063683 2023-07-16 22:11:03,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-16 22:11:03,708 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-16 22:11:03,708 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:03,709 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 22:11:03,709 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 22:11:03,710 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,710 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,712 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,712 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,712 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:03,712 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:03,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:03,713 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,713 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,713 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,713 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:03,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:03,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 22:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 22:11:03,716 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:03,716 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 22:11:03,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 22:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 22:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:03,722 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:03,722 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:03,723 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 22:11:03,723 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:03,722 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 22:11:03,723 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:03,723 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:03,723 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 22:11:03,726 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,726 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,727 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,727 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,727 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,728 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,727 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,728 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,728 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,728 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:03,728 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:03,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 22:11:03,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0692e6[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:03,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:03,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:03,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:03,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:03,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:03,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:03,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:03,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 22:11:03,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0692e6[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:03,734 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 22:11:03,734 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,740 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,740 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,740 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:03,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,741 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:03,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:03,741 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:03,741 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:03,741 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:03,741 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. started... 2023-07-16 22:11:03,742 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. started... 2023-07-16 22:11:03,742 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:03,742 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4938e55d55c9a93b86f362e46021d63c 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 22:11:03,742 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1e62a12b32e90dc46c071aa583c3047f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 22:11:03,748 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:03,748 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:03,748 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:03,777 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:03,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:03,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:03,779 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:03,927 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716e3a9e07f22074c309b28b05eacf392b2 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716e3a9e07f22074c309b28b05eacf392b2 2023-07-16 22:11:03,961 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/.tmp/cf/5e3912d5715d439988dce73cacb821d0 2023-07-16 22:11:03,975 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/.tmp/cf/5e3912d5715d439988dce73cacb821d0 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf/5e3912d5715d439988dce73cacb821d0 2023-07-16 22:11:03,980 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:03,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:03,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:03,985 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:11:03,992 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf/5e3912d5715d439988dce73cacb821d0, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 22:11:03,994 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 4938e55d55c9a93b86f362e46021d63c in 252ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:03,994 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 22:11:03,995 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4938e55d55c9a93b86f362e46021d63c: 2023-07-16 22:11:03,996 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:03,996 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:03,996 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf/5e3912d5715d439988dce73cacb821d0] hfiles 2023-07-16 22:11:03,997 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf/5e3912d5715d439988dce73cacb821d0 for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:04,041 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. completed. 2023-07-16 22:11:04,041 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:04,041 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:04,041 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:04,041 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,041 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:04,042 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:11:04,044 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,044 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:04,044 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:04,044 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:04,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:04,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:04,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41119,1689545452128': 2023-07-16 22:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 22:11:04,277 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716a55ec3d8088643fca85a7377e85bdf63 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716a55ec3d8088643fca85a7377e85bdf63 2023-07-16 22:11:04,286 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:04,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:04,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:04,293 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 22:11:04,302 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/.tmp/cf/6aeabb05ebfe4205a568f85b3247dba2 2023-07-16 22:11:04,312 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/.tmp/cf/6aeabb05ebfe4205a568f85b3247dba2 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf/6aeabb05ebfe4205a568f85b3247dba2 2023-07-16 22:11:04,321 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf/6aeabb05ebfe4205a568f85b3247dba2, entries=47, sequenceid=6, filesize=12.8 K 2023-07-16 22:11:04,324 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 1e62a12b32e90dc46c071aa583c3047f in 582ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:04,326 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e62a12b32e90dc46c071aa583c3047f: 2023-07-16 22:11:04,326 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf/6aeabb05ebfe4205a568f85b3247dba2] hfiles 2023-07-16 22:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf/6aeabb05ebfe4205a568f85b3247dba2 for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:04,350 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. completed. 2023-07-16 22:11:04,350 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:04,351 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 22:11:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:11:04,354 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,354 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 22:11:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:04,354 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:04,354 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 22:11:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:11:04,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 22:11:04,360 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-16 22:11:04,360 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:04,360 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:04,360 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-16 22:11:04,360 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:04,363 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:04,363 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:04,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,363 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:04,364 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:04,364 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:04,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:04,365 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:04,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:04,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:04,371 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 22:11:04,372 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,372 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,387 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:04,388 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:04,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:04,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:04,387 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:04,388 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:04,388 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:04,388 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:04,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:04,388 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,388 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:04,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-16 22:11:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:04,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-16 22:11:04,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:04,388 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:04,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 22:11:04,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:11:04,390 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:04,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:04,391 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,391 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,391 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:04,391 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,391 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:04,391 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:04,391 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,391 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716a55ec3d8088643fca85a7377e85bdf63, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716e3a9e07f22074c309b28b05eacf392b2] mob files 2023-07-16 22:11:04,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716a55ec3d8088643fca85a7377e85bdf63 2023-07-16 22:11:04,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716e3a9e07f22074c309b28b05eacf392b2 2023-07-16 22:11:04,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-16 22:11:04,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 22:11:04,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,539 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 22:11:04,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689545463675Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689545464428 (+753 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689545464428Loading Region manifests for snaptb0-testExportWithTargetName at 1689545464428Writing data manifest for snaptb0-testExportWithTargetName at 1689545464437 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689545464466 (+29 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689545464538 (+72 ms) 2023-07-16 22:11:04,542 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 22:11:04,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 868 msec 2023-07-16 22:11:04,793 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:04,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 22:11:04,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:04,798 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798 2023-07-16 22:11:04,799 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38033, tgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798, rawTgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798, srcFsUri=hdfs://localhost:38033, srcDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:11:04,855 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:11:04,855 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1711111306_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 22:11:04,855 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6, snapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-16 22:11:04,896 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 22:11:05,458 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,459 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,460 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,460 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,461 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,461 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,461 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,552 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop-6586037621966368047.jar 2023-07-16 22:11:05,553 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,554 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,554 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,555 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,556 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,556 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:05,556 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:11:05,557 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:11:05,557 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:11:05,558 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:11:05,558 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:11:05,559 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:11:05,560 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:11:05,560 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:11:05,560 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:11:05,561 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:11:05,565 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:05,565 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:05,565 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:05,566 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:05,566 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:05,566 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:05,567 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:06,494 WARN [Listener at jenkins-hbase4.apache.org/36941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:11:06,502 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-16 22:11:06,513 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-16 22:11:07,089 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:07,091 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:07,596 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0001_000001 (auth:SIMPLE) 2023-07-16 22:11:07,618 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:11:12,965 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0001_000001 (auth:SIMPLE) 2023-07-16 22:11:15,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0001_000001 (auth:SIMPLE) 2023-07-16 22:11:21,496 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:11:21,498 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:11:21,515 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-16 22:11:21,515 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:11:21,516 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:11:21,516 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 22:11:21,517 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-16 22:11:21,517 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-16 22:11:21,517 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798/.hbase-snapshot/testExportWithTargetName 2023-07-16 22:11:21,518 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-16 22:11:21,518 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545464798/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-16 22:11:21,539 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-16 22:11:21,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-16 22:11:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:21,564 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545481564"}]},"ts":"1689545481564"} 2023-07-16 22:11:21,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 22:11:21,567 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-16 22:11:21,570 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-16 22:11:21,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4938e55d55c9a93b86f362e46021d63c, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1e62a12b32e90dc46c071aa583c3047f, UNASSIGN}] 2023-07-16 22:11:21,576 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4938e55d55c9a93b86f362e46021d63c, UNASSIGN 2023-07-16 22:11:21,576 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1e62a12b32e90dc46c071aa583c3047f, UNASSIGN 2023-07-16 22:11:21,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1e62a12b32e90dc46c071aa583c3047f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:21,577 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4938e55d55c9a93b86f362e46021d63c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:21,577 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545481577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545481577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545481577"}]},"ts":"1689545481577"} 2023-07-16 22:11:21,577 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545481577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545481577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545481577"}]},"ts":"1689545481577"} 2023-07-16 22:11:21,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 1e62a12b32e90dc46c071aa583c3047f, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:11:21,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 4938e55d55c9a93b86f362e46021d63c, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:11:21,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 22:11:21,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:21,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:21,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4938e55d55c9a93b86f362e46021d63c, disabling compactions & flushes 2023-07-16 22:11:21,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e62a12b32e90dc46c071aa583c3047f, disabling compactions & flushes 2023-07-16 22:11:21,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:21,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. after waiting 0 ms 2023-07-16 22:11:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. after waiting 0 ms 2023-07-16 22:11:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:21,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:11:21,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:21,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c. 2023-07-16 22:11:21,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:11:21,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4938e55d55c9a93b86f362e46021d63c: 2023-07-16 22:11:21,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:21,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f. 2023-07-16 22:11:21,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e62a12b32e90dc46c071aa583c3047f: 2023-07-16 22:11:21,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:21,774 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4938e55d55c9a93b86f362e46021d63c, regionState=CLOSED 2023-07-16 22:11:21,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:21,774 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545481774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545481774"}]},"ts":"1689545481774"} 2023-07-16 22:11:21,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1e62a12b32e90dc46c071aa583c3047f, regionState=CLOSED 2023-07-16 22:11:21,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689545481775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545481775"}]},"ts":"1689545481775"} 2023-07-16 22:11:21,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-16 22:11:21,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 4938e55d55c9a93b86f362e46021d63c, server=jenkins-hbase4.apache.org,41119,1689545452128 in 197 msec 2023-07-16 22:11:21,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-16 22:11:21,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 1e62a12b32e90dc46c071aa583c3047f, server=jenkins-hbase4.apache.org,38577,1689545452169 in 203 msec 2023-07-16 22:11:21,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4938e55d55c9a93b86f362e46021d63c, UNASSIGN in 217 msec 2023-07-16 22:11:21,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-16 22:11:21,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1e62a12b32e90dc46c071aa583c3047f, UNASSIGN in 219 msec 2023-07-16 22:11:21,795 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545481795"}]},"ts":"1689545481795"} 2023-07-16 22:11:21,797 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-16 22:11:21,799 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-16 22:11:21,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 250 msec 2023-07-16 22:11:21,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 22:11:21,870 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-16 22:11:21,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-16 22:11:21,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:21,888 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:21,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-16 22:11:21,890 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:21,895 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-16 22:11:21,897 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:21,897 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:21,900 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:21,900 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:21,900 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:21,901 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:21,901 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/recovered.edits] 2023-07-16 22:11:21,901 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/recovered.edits] 2023-07-16 22:11:21,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 22:11:21,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 22:11:21,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 22:11:21,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 22:11:21,909 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:21,909 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:21,909 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:21,909 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:21,909 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:21,909 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:21,910 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 22:11:21,910 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:21,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 22:11:21,914 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf/6aeabb05ebfe4205a568f85b3247dba2 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/cf/6aeabb05ebfe4205a568f85b3247dba2 2023-07-16 22:11:21,918 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf/5e3912d5715d439988dce73cacb821d0 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/cf/5e3912d5715d439988dce73cacb821d0 2023-07-16 22:11:21,927 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c/recovered.edits/9.seqid 2023-07-16 22:11:21,928 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/4938e55d55c9a93b86f362e46021d63c 2023-07-16 22:11:21,929 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f/recovered.edits/9.seqid 2023-07-16 22:11:21,930 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportWithTargetName/1e62a12b32e90dc46c071aa583c3047f 2023-07-16 22:11:21,930 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 22:11:21,931 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-16 22:11:21,932 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-16 22:11:21,937 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716a55ec3d8088643fca85a7377e85bdf63 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716a55ec3d8088643fca85a7377e85bdf63 2023-07-16 22:11:21,940 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716e3a9e07f22074c309b28b05eacf392b2 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716e3a9e07f22074c309b28b05eacf392b2 2023-07-16 22:11:21,940 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-16 22:11:21,944 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:21,969 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-16 22:11:21,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-16 22:11:21,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:21,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-16 22:11:21,979 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545481979"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:21,979 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545481979"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:21,982 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:11:21,982 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4938e55d55c9a93b86f362e46021d63c, NAME => 'testtb-testExportWithTargetName,,1689545461551.4938e55d55c9a93b86f362e46021d63c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1e62a12b32e90dc46c071aa583c3047f, NAME => 'testtb-testExportWithTargetName,1,1689545461551.1e62a12b32e90dc46c071aa583c3047f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:11:21,982 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-16 22:11:21,982 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545481982"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:21,985 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-16 22:11:22,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 22:11:22,075 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 22:11:22,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 197 msec 2023-07-16 22:11:22,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 22:11:22,218 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-16 22:11:22,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-16 22:11:22,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-16 22:11:22,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-16 22:11:22,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-16 22:11:22,275 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 703) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1314 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:59894 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:43981 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1288113161_17 at /127.0.0.1:37760 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:53752 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-736849288_1 at /127.0.0.1:42918 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-736849288_1 at /127.0.0.1:51038 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:36657 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:39317 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 243) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=2820 (was 4635) 2023-07-16 22:11:22,276 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-16 22:11:22,296 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=181, AvailableMemoryMB=2820 2023-07-16 22:11:22,296 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-16 22:11:22,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 22:11:22,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:22,304 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:11:22,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-16 22:11:22,306 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:11:22,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:22,309 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,309 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,310 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057 empty. 2023-07-16 22:11:22,310 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061 empty. 2023-07-16 22:11:22,310 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,310 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 22:11:22,322 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 22:11:22,323 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => ab6e50305655837c6f5a37b71c2c4061, NAME => 'testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:11:22,324 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a1f514fb489279e6eff154d57c71f057, NAME => 'testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:11:22,340 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:22,341 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing ab6e50305655837c6f5a37b71c2c4061, disabling compactions & flushes 2023-07-16 22:11:22,341 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:22,341 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:22,341 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. after waiting 0 ms 2023-07-16 22:11:22,341 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:22,342 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:22,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:22,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for ab6e50305655837c6f5a37b71c2c4061: 2023-07-16 22:11:22,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a1f514fb489279e6eff154d57c71f057, disabling compactions & flushes 2023-07-16 22:11:22,343 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:22,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:22,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. after waiting 0 ms 2023-07-16 22:11:22,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:22,343 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:22,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a1f514fb489279e6eff154d57c71f057: 2023-07-16 22:11:22,346 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:11:22,347 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545482347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545482347"}]},"ts":"1689545482347"} 2023-07-16 22:11:22,347 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545482347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545482347"}]},"ts":"1689545482347"} 2023-07-16 22:11:22,353 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:11:22,355 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:11:22,355 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545482355"}]},"ts":"1689545482355"} 2023-07-16 22:11:22,359 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 22:11:22,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:22,473 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:11:22,475 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:11:22,475 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:11:22,475 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:11:22,475 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:11:22,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ab6e50305655837c6f5a37b71c2c4061, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1f514fb489279e6eff154d57c71f057, ASSIGN}] 2023-07-16 22:11:22,478 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1f514fb489279e6eff154d57c71f057, ASSIGN 2023-07-16 22:11:22,479 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ab6e50305655837c6f5a37b71c2c4061, ASSIGN 2023-07-16 22:11:22,480 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1f514fb489279e6eff154d57c71f057, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41119,1689545452128; forceNewPlan=false, retain=false 2023-07-16 22:11:22,480 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ab6e50305655837c6f5a37b71c2c4061, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38577,1689545452169; forceNewPlan=false, retain=false 2023-07-16 22:11:22,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:22,630 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:11:22,633 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ab6e50305655837c6f5a37b71c2c4061, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:22,633 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a1f514fb489279e6eff154d57c71f057, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:22,633 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545482633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545482633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545482633"}]},"ts":"1689545482633"} 2023-07-16 22:11:22,633 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545482632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545482632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545482632"}]},"ts":"1689545482632"} 2023-07-16 22:11:22,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure ab6e50305655837c6f5a37b71c2c4061, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:11:22,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure a1f514fb489279e6eff154d57c71f057, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:11:22,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:22,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ab6e50305655837c6f5a37b71c2c4061, NAME => 'testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:11:22,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. service=AccessControlService 2023-07-16 22:11:22,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:22,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:22,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:22,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1f514fb489279e6eff154d57c71f057, NAME => 'testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:11:22,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. service=AccessControlService 2023-07-16 22:11:22,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:22,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:22,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,793 INFO [StoreOpener-ab6e50305655837c6f5a37b71c2c4061-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,794 INFO [StoreOpener-a1f514fb489279e6eff154d57c71f057-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,795 DEBUG [StoreOpener-ab6e50305655837c6f5a37b71c2c4061-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf 2023-07-16 22:11:22,795 DEBUG [StoreOpener-ab6e50305655837c6f5a37b71c2c4061-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf 2023-07-16 22:11:22,795 INFO [StoreOpener-ab6e50305655837c6f5a37b71c2c4061-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab6e50305655837c6f5a37b71c2c4061 columnFamilyName cf 2023-07-16 22:11:22,796 DEBUG [StoreOpener-a1f514fb489279e6eff154d57c71f057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf 2023-07-16 22:11:22,796 DEBUG [StoreOpener-a1f514fb489279e6eff154d57c71f057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf 2023-07-16 22:11:22,796 INFO [StoreOpener-a1f514fb489279e6eff154d57c71f057-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1f514fb489279e6eff154d57c71f057 columnFamilyName cf 2023-07-16 22:11:22,797 INFO [StoreOpener-ab6e50305655837c6f5a37b71c2c4061-1] regionserver.HStore(310): Store=ab6e50305655837c6f5a37b71c2c4061/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:22,801 INFO [StoreOpener-a1f514fb489279e6eff154d57c71f057-1] regionserver.HStore(310): Store=a1f514fb489279e6eff154d57c71f057/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:22,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:22,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:22,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:22,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:22,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1f514fb489279e6eff154d57c71f057; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60880619, jitterRate=-0.0928080826997757}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:22,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1f514fb489279e6eff154d57c71f057: 2023-07-16 22:11:22,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ab6e50305655837c6f5a37b71c2c4061; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72793297, jitterRate=0.08470465242862701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:22,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ab6e50305655837c6f5a37b71c2c4061: 2023-07-16 22:11:22,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057., pid=31, masterSystemTime=1689545482789 2023-07-16 22:11:22,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061., pid=30, masterSystemTime=1689545482787 2023-07-16 22:11:22,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:22,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:22,812 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a1f514fb489279e6eff154d57c71f057, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:22,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:22,813 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545482812"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545482812"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545482812"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545482812"}]},"ts":"1689545482812"} 2023-07-16 22:11:22,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:22,813 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ab6e50305655837c6f5a37b71c2c4061, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:22,814 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545482813"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545482813"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545482813"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545482813"}]},"ts":"1689545482813"} 2023-07-16 22:11:22,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-16 22:11:22,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure a1f514fb489279e6eff154d57c71f057, server=jenkins-hbase4.apache.org,41119,1689545452128 in 178 msec 2023-07-16 22:11:22,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-16 22:11:22,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure ab6e50305655837c6f5a37b71c2c4061, server=jenkins-hbase4.apache.org,38577,1689545452169 in 181 msec 2023-07-16 22:11:22,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1f514fb489279e6eff154d57c71f057, ASSIGN in 342 msec 2023-07-16 22:11:22,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-16 22:11:22,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ab6e50305655837c6f5a37b71c2c4061, ASSIGN in 343 msec 2023-07-16 22:11:22,822 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:11:22,822 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545482822"}]},"ts":"1689545482822"} 2023-07-16 22:11:22,824 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 22:11:22,890 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:11:22,890 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-16 22:11:22,893 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:11:22,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:22,943 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:22,943 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:22,943 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:22,943 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:23,035 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:23,035 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:23,035 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:23,035 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:23,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 736 msec 2023-07-16 22:11:23,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 22:11:23,412 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-16 22:11:23,414 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 22:11:23,414 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:23,417 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:23,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:23,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545483429 (current time:1689545483429). 2023-07-16 22:11:23,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:23,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x50e68dd1 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:23,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a81069a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:23,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:23,530 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:23,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50e68dd1 to 127.0.0.1:58223 2023-07-16 22:11:23,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:23,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x77c6e5a4 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:23,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@132a7688, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:23,699 DEBUG [hconnection-0x10d07a1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:23,702 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:23,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:23,709 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:23,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77c6e5a4 to 127.0.0.1:58223 2023-07-16 22:11:23,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:23,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:11:23,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:23,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:23,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:23,715 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:23,716 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689546083716 2023-07-16 22:11:23,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:23,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 22:11:23,718 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:23,718 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:23,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:23,719 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:23,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-16 22:11:23,721 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:23,722 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689546083722 2023-07-16 22:11:23,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,736 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-16 22:11:23,736 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:23,737 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 22:11:23,737 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 22:11:23,805 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,805 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,818 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:23,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:23,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:23,819 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:23,996 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:23,997 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:23,996 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:23,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:23,996 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:23,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:23,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:23,997 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:23,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:23,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:23,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:23,997 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:23,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,998 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:23,998 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 22:11:23,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:23,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:23,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:23,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:23,999 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:23,999 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:23,999 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:23,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,001 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:24,001 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:24,001 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:23,999 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:24,002 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:24,003 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:24,003 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:24,001 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:24,003 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:24,003 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:24,003 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:24,003 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:24,020 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:24,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:24,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:24,021 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:11:24,151 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,151 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,151 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,151 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,152 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:24,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 22:11:24,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@143677e7[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:24,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:24,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 22:11:24,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@143677e7[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:24,157 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 22:11:24,157 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,204 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:24,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,204 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:24,205 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,205 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:11:24,205 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:24,205 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,205 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:24,205 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:24,205 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:24,205 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:24,205 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:24,205 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. started... 2023-07-16 22:11:24,205 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:24,205 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:24,205 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. started... 2023-07-16 22:11:24,205 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ab6e50305655837c6f5a37b71c2c4061: 2023-07-16 22:11:24,207 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1f514fb489279e6eff154d57c71f057: 2023-07-16 22:11:24,207 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,207 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,207 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:24,207 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:24,207 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:24,207 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:24,217 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. completed. 2023-07-16 22:11:24,217 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:24,217 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:24,217 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:24,217 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,218 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. completed. 2023-07-16 22:11:24,218 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:24,218 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:24,218 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:11:24,218 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:24,218 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:24,218 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,218 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:24,218 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:11:24,219 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:24,219 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:24,219 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:24,250 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:24,250 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,250 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:24,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,250 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:24,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:24,250 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:24,250 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,250 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:24,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:24,252 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:24,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:24,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:24,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:24,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:11:24,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 22:11:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:24,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:24,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41119,1689545452128': 2023-07-16 22:11:24,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 22:11:24,261 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-16 22:11:24,261 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:24,261 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:24,261 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,261 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:24,312 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:24,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:24,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:24,313 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:24,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:24,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:24,313 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,314 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,316 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:24,316 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,317 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,321 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:24,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:24,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:24,323 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 22:11:24,373 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:24,373 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:24,373 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:24,373 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:24,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,374 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:24,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:24,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:24,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:24,373 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:24,373 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:24,375 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:24,375 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:24,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:24,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-16 22:11:24,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:24,376 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:24,376 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:11:24,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:24,376 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,377 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,377 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,377 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,377 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,377 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,377 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 22:11:24,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,407 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 22:11:24,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 22:11:24,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,443 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:24,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689545483717Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689545484386 (+669 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689545484386Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689545484386Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689545484391 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689545484404 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689545484442 (+38 ms) 2023-07-16 22:11:24,445 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:24,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 728 msec 2023-07-16 22:11:24,823 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:24,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:24,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:24,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:24,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41119] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:24,834 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 22:11:24,834 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:24,834 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:24,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:24,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545484846 (current time:1689545484846). 2023-07-16 22:11:24,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:24,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x1e2754ab to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:24,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36dd7e34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:24,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:24,859 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:24,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e2754ab to 127.0.0.1:58223 2023-07-16 22:11:24,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:24,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x03c42a29 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:24,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a1342e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:24,869 DEBUG [hconnection-0x737b5258-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:24,870 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:24,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:24,876 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:24,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03c42a29 to 127.0.0.1:58223 2023-07-16 22:11:24,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:24,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:11:24,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:24,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:24,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:24,882 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:24,883 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689546084883 2023-07-16 22:11:24,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 22:11:24,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:11:24,884 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:24,885 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:24,886 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:11:24,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:24,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 22:11:24,888 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:24,889 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689546084889 2023-07-16 22:11:24,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-16 22:11:24,902 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-16 22:11:24,902 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:24,904 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 22:11:24,904 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 22:11:24,904 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,904 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,906 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:24,906 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:24,906 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:24,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,907 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,907 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,909 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:24,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:24,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:24,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,909 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,909 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:24,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 22:11:24,911 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 22:11:24,911 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:24,911 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:24,912 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:24,912 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:24,912 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:24,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 22:11:24,912 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:24,912 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:24,914 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 22:11:24,915 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:24,915 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 22:11:24,915 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:24,915 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:24,914 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,915 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:24,915 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,916 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 22:11:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:24,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:24,916 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 22:11:24,916 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:24,917 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 22:11:24,918 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:24,918 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,920 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:24,920 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,920 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:24,920 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,920 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:24,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:24,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:24,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 22:11:24,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257204dd[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:24,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:24,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:24,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:24,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:24,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:24,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:24,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:24,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 22:11:24,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257204dd[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:24,925 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 22:11:24,925 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,926 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,926 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,926 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:24,926 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:24,926 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:24,926 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:11:24,926 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:24,926 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:24,926 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:24,927 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:24,926 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,927 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. started... 2023-07-16 22:11:24,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:24,928 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:11:24,928 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ab6e50305655837c6f5a37b71c2c4061 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 22:11:24,928 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:24,928 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:24,928 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:24,928 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:24,928 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:24,928 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:24,928 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:24,928 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. started... 2023-07-16 22:11:24,928 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:24,929 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a1f514fb489279e6eff154d57c71f057 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 22:11:24,964 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307161d9f5910feef450f88026da8f18a2e79 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307161d9f5910feef450f88026da8f18a2e79 2023-07-16 22:11:24,971 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716edefddc94a6f4dad8a6f1ed4b9590899 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230716edefddc94a6f4dad8a6f1ed4b9590899 2023-07-16 22:11:24,985 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:24,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:24,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:24,986 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:24,992 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/.tmp/cf/90e32e201fc743d5884e40343feff4ea 2023-07-16 22:11:25,000 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/.tmp/cf/f7a3e75b58d54a1481f8153a1edc0d26 2023-07-16 22:11:25,001 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/.tmp/cf/90e32e201fc743d5884e40343feff4ea as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf/90e32e201fc743d5884e40343feff4ea 2023-07-16 22:11:25,007 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/.tmp/cf/f7a3e75b58d54a1481f8153a1edc0d26 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf/f7a3e75b58d54a1481f8153a1edc0d26 2023-07-16 22:11:25,007 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf/90e32e201fc743d5884e40343feff4ea, entries=5, sequenceid=6, filesize=5.7 K 2023-07-16 22:11:25,008 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for ab6e50305655837c6f5a37b71c2c4061 in 80ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:25,010 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ab6e50305655837c6f5a37b71c2c4061: 2023-07-16 22:11:25,010 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:25,010 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:25,010 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf/90e32e201fc743d5884e40343feff4ea] hfiles 2023-07-16 22:11:25,011 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf/90e32e201fc743d5884e40343feff4ea for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:25,017 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf/f7a3e75b58d54a1481f8153a1edc0d26, entries=45, sequenceid=6, filesize=12.5 K 2023-07-16 22:11:25,018 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a1f514fb489279e6eff154d57c71f057 in 89ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:25,018 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1f514fb489279e6eff154d57c71f057: 2023-07-16 22:11:25,019 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:25,019 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:25,019 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf/f7a3e75b58d54a1481f8153a1edc0d26] hfiles 2023-07-16 22:11:25,019 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf/f7a3e75b58d54a1481f8153a1edc0d26 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:25,023 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. completed. 2023-07-16 22:11:25,023 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:25,023 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:25,023 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:25,023 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,023 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:25,023 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:11:25,030 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:25,031 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,031 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:25,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,031 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. completed. 2023-07-16 22:11:25,031 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:25,032 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:25,033 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:25,033 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:25,033 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:25,033 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 22:11:25,033 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:11:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:25,035 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:25,035 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 22:11:25,035 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:25,035 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 22:11:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:25,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:11:25,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 22:11:25,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:25,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:25,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:25,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:25,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:25,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:25,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41119,1689545452128': 2023-07-16 22:11:25,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 22:11:25,043 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-16 22:11:25,043 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:25,043 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:25,043 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-16 22:11:25,043 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:25,045 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:25,045 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:25,045 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:25,045 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:25,046 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,046 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:25,047 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,049 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,050 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:25,050 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 22:11:25,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,054 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,054 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:25,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:25,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:25,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-16 22:11:25,055 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:25,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 22:11:25,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:25,055 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:25,057 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:25,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:25,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:11:25,057 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:25,058 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:25,058 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:25,058 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,058 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307161d9f5910feef450f88026da8f18a2e79, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230716edefddc94a6f4dad8a6f1ed4b9590899] mob files 2023-07-16 22:11:25,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307161d9f5910feef450f88026da8f18a2e79 2023-07-16 22:11:25,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230716edefddc94a6f4dad8a6f1ed4b9590899 2023-07-16 22:11:25,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-16 22:11:25,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 22:11:25,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,141 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689545484883Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689545485067 (+184 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689545485067Loading Region manifests for snaptb0-testExportFileSystemState at 1689545485067Writing data manifest for snaptb0-testExportFileSystemState at 1689545485072 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689545485083 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689545485140 (+57 ms) 2023-07-16 22:11:25,144 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 22:11:25,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 260 msec 2023-07-16 22:11:25,186 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:25,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:11:25,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:25,188 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188 2023-07-16 22:11:25,188 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38033, tgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188, rawTgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188, srcFsUri=hdfs://localhost:38033, srcDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:11:25,219 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:11:25,219 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1780985849_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,219 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6, snapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-16 22:11:25,235 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 22:11:25,297 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,298 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,298 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,298 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,299 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,299 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,299 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,377 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop-2709234737666304661.jar 2023-07-16 22:11:25,378 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,378 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,379 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,379 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,379 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,380 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:25,380 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:11:25,381 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:11:25,381 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:11:25,382 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:11:25,382 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:11:25,383 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:11:25,383 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:11:25,383 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:11:25,384 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:11:25,384 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:11:25,385 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:25,385 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:25,385 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:25,386 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:25,386 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:25,386 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:25,387 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:25,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0001_000001 (auth:SIMPLE) 2023-07-16 22:11:25,963 WARN [Listener at jenkins-hbase4.apache.org/36941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:11:25,966 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-16 22:11:25,969 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-16 22:11:26,092 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:26,092 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:26,677 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:27,390 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:11:31,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:33,553 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:36,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:38,227 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:11:38,230 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:11:38,239 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-16 22:11:38,240 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:11:38,240 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:11:38,240 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 22:11:38,241 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 22:11:38,241 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 22:11:38,241 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 22:11:38,242 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 22:11:38,242 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545485188/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 22:11:38,250 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-16 22:11:38,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-16 22:11:38,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:38,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 22:11:38,256 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545498256"}]},"ts":"1689545498256"} 2023-07-16 22:11:38,258 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 22:11:38,260 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-16 22:11:38,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ab6e50305655837c6f5a37b71c2c4061, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1f514fb489279e6eff154d57c71f057, UNASSIGN}] 2023-07-16 22:11:38,263 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1f514fb489279e6eff154d57c71f057, UNASSIGN 2023-07-16 22:11:38,263 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ab6e50305655837c6f5a37b71c2c4061, UNASSIGN 2023-07-16 22:11:38,264 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a1f514fb489279e6eff154d57c71f057, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:38,264 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ab6e50305655837c6f5a37b71c2c4061, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:38,264 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545498264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545498264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545498264"}]},"ts":"1689545498264"} 2023-07-16 22:11:38,264 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545498264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545498264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545498264"}]},"ts":"1689545498264"} 2023-07-16 22:11:38,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure ab6e50305655837c6f5a37b71c2c4061, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:11:38,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure a1f514fb489279e6eff154d57c71f057, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:11:38,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 22:11:38,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:38,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ab6e50305655837c6f5a37b71c2c4061, disabling compactions & flushes 2023-07-16 22:11:38,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:38,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:38,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. after waiting 0 ms 2023-07-16 22:11:38,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:38,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1f514fb489279e6eff154d57c71f057, disabling compactions & flushes 2023-07-16 22:11:38,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. after waiting 0 ms 2023-07-16 22:11:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:38,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:11:38,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:38,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061. 2023-07-16 22:11:38,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ab6e50305655837c6f5a37b71c2c4061: 2023-07-16 22:11:38,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:11:38,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:11:38,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057. 2023-07-16 22:11:38,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:38,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1f514fb489279e6eff154d57c71f057: 2023-07-16 22:11:38,440 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ab6e50305655837c6f5a37b71c2c4061, regionState=CLOSED 2023-07-16 22:11:38,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545498440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545498440"}]},"ts":"1689545498440"} 2023-07-16 22:11:38,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:38,441 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a1f514fb489279e6eff154d57c71f057, regionState=CLOSED 2023-07-16 22:11:38,441 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689545498441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545498441"}]},"ts":"1689545498441"} 2023-07-16 22:11:38,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-16 22:11:38,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure ab6e50305655837c6f5a37b71c2c4061, server=jenkins-hbase4.apache.org,38577,1689545452169 in 176 msec 2023-07-16 22:11:38,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-16 22:11:38,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure a1f514fb489279e6eff154d57c71f057, server=jenkins-hbase4.apache.org,41119,1689545452128 in 175 msec 2023-07-16 22:11:38,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ab6e50305655837c6f5a37b71c2c4061, UNASSIGN in 185 msec 2023-07-16 22:11:38,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-16 22:11:38,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1f514fb489279e6eff154d57c71f057, UNASSIGN in 185 msec 2023-07-16 22:11:38,449 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545498448"}]},"ts":"1689545498448"} 2023-07-16 22:11:38,450 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 22:11:38,452 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-16 22:11:38,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 203 msec 2023-07-16 22:11:38,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 22:11:38,558 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-16 22:11:38,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-16 22:11:38,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:38,563 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:38,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-16 22:11:38,564 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:38,565 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-16 22:11:38,569 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:38,569 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:38,569 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:38,569 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:38,569 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:38,569 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:38,569 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 22:11:38,569 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 22:11:38,570 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 22:11:38,570 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:38,570 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:38,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-16 22:11:38,571 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:38,571 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:11:38,571 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 22:11:38,571 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:38,571 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:38,571 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:38,571 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/recovered.edits] 2023-07-16 22:11:38,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 22:11:38,572 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/recovered.edits] 2023-07-16 22:11:38,576 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf/90e32e201fc743d5884e40343feff4ea to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/cf/90e32e201fc743d5884e40343feff4ea 2023-07-16 22:11:38,576 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf/f7a3e75b58d54a1481f8153a1edc0d26 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/cf/f7a3e75b58d54a1481f8153a1edc0d26 2023-07-16 22:11:38,579 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061/recovered.edits/9.seqid 2023-07-16 22:11:38,579 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057/recovered.edits/9.seqid 2023-07-16 22:11:38,580 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/ab6e50305655837c6f5a37b71c2c4061 2023-07-16 22:11:38,580 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemState/a1f514fb489279e6eff154d57c71f057 2023-07-16 22:11:38,580 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 22:11:38,580 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-16 22:11:38,581 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-16 22:11:38,584 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307161d9f5910feef450f88026da8f18a2e79 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307161d9f5910feef450f88026da8f18a2e79 2023-07-16 22:11:38,586 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230716edefddc94a6f4dad8a6f1ed4b9590899 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230716edefddc94a6f4dad8a6f1ed4b9590899 2023-07-16 22:11:38,586 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-16 22:11:38,588 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:38,591 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-16 22:11:38,593 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-16 22:11:38,594 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:38,594 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-16 22:11:38,594 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545498594"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:38,594 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545498594"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:38,596 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:11:38,596 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ab6e50305655837c6f5a37b71c2c4061, NAME => 'testtb-testExportFileSystemState,,1689545482298.ab6e50305655837c6f5a37b71c2c4061.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a1f514fb489279e6eff154d57c71f057, NAME => 'testtb-testExportFileSystemState,1,1689545482298.a1f514fb489279e6eff154d57c71f057.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:11:38,596 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-16 22:11:38,596 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545498596"}]},"ts":"9223372036854775807"} 2023-07-16 22:11:38,598 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-16 22:11:38,600 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 22:11:38,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-07-16 22:11:38,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 22:11:38,673 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-16 22:11:38,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-16 22:11:38,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-16 22:11:38,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-16 22:11:38,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-16 22:11:38,713 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757 (was 751) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:56446 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:46729 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-2144 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:36098 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:56530 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1639469909_1 at /127.0.0.1:36070 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=348 (was 312) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=2670 (was 2820) 2023-07-16 22:11:38,714 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-16 22:11:38,734 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=757, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=348, ProcessCount=181, AvailableMemoryMB=2668 2023-07-16 22:11:38,734 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-16 22:11:38,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 22:11:38,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:11:38,739 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:11:38,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-16 22:11:38,740 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:11:38,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 22:11:38,742 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:38,742 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:38,743 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889 empty. 2023-07-16 22:11:38,743 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143 empty. 2023-07-16 22:11:38,743 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:38,743 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:38,744 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 22:11:38,756 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-16 22:11:38,757 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 140e6d510fc8fd283891fd8a58f95889, NAME => 'testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:11:38,757 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4c83b35e51e4b8b4af719e98ccaf9143, NAME => 'testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 140e6d510fc8fd283891fd8a58f95889, disabling compactions & flushes 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 4c83b35e51e4b8b4af719e98ccaf9143, disabling compactions & flushes 2023-07-16 22:11:38,784 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:38,784 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. after waiting 0 ms 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. after waiting 0 ms 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:38,784 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:38,784 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:38,784 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 140e6d510fc8fd283891fd8a58f95889: 2023-07-16 22:11:38,785 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 4c83b35e51e4b8b4af719e98ccaf9143: 2023-07-16 22:11:38,787 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:11:38,788 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545498788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545498788"}]},"ts":"1689545498788"} 2023-07-16 22:11:38,788 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545498788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545498788"}]},"ts":"1689545498788"} 2023-07-16 22:11:38,790 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:11:38,791 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:11:38,791 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545498791"}]},"ts":"1689545498791"} 2023-07-16 22:11:38,793 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-16 22:11:38,796 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:11:38,797 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:11:38,797 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:11:38,797 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:11:38,798 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:11:38,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=140e6d510fc8fd283891fd8a58f95889, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4c83b35e51e4b8b4af719e98ccaf9143, ASSIGN}] 2023-07-16 22:11:38,800 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=140e6d510fc8fd283891fd8a58f95889, ASSIGN 2023-07-16 22:11:38,800 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4c83b35e51e4b8b4af719e98ccaf9143, ASSIGN 2023-07-16 22:11:38,801 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4c83b35e51e4b8b4af719e98ccaf9143, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37353,1689545452057; forceNewPlan=false, retain=false 2023-07-16 22:11:38,801 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=140e6d510fc8fd283891fd8a58f95889, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41119,1689545452128; forceNewPlan=false, retain=false 2023-07-16 22:11:38,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 22:11:38,951 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:11:38,954 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=4c83b35e51e4b8b4af719e98ccaf9143, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:38,954 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=140e6d510fc8fd283891fd8a58f95889, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:38,954 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545498954"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545498954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545498954"}]},"ts":"1689545498954"} 2023-07-16 22:11:38,955 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545498954"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545498954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545498954"}]},"ts":"1689545498954"} 2023-07-16 22:11:38,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 4c83b35e51e4b8b4af719e98ccaf9143, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:11:38,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 140e6d510fc8fd283891fd8a58f95889, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:11:39,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 22:11:39,110 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,110 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:11:39,114 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:11:39,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 140e6d510fc8fd283891fd8a58f95889, NAME => 'testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:11:39,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. service=AccessControlService 2023-07-16 22:11:39,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:39,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:39,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:39,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:39,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:39,120 INFO [StoreOpener-140e6d510fc8fd283891fd8a58f95889-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:39,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:39,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c83b35e51e4b8b4af719e98ccaf9143, NAME => 'testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:11:39,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. service=AccessControlService 2023-07-16 22:11:39,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:11:39,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:39,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:11:39,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:39,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:39,122 DEBUG [StoreOpener-140e6d510fc8fd283891fd8a58f95889-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf 2023-07-16 22:11:39,122 DEBUG [StoreOpener-140e6d510fc8fd283891fd8a58f95889-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf 2023-07-16 22:11:39,122 INFO [StoreOpener-140e6d510fc8fd283891fd8a58f95889-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 140e6d510fc8fd283891fd8a58f95889 columnFamilyName cf 2023-07-16 22:11:39,122 INFO [StoreOpener-4c83b35e51e4b8b4af719e98ccaf9143-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:39,124 INFO [StoreOpener-140e6d510fc8fd283891fd8a58f95889-1] regionserver.HStore(310): Store=140e6d510fc8fd283891fd8a58f95889/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:39,124 DEBUG [StoreOpener-4c83b35e51e4b8b4af719e98ccaf9143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf 2023-07-16 22:11:39,124 DEBUG [StoreOpener-4c83b35e51e4b8b4af719e98ccaf9143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf 2023-07-16 22:11:39,124 INFO [StoreOpener-4c83b35e51e4b8b4af719e98ccaf9143-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c83b35e51e4b8b4af719e98ccaf9143 columnFamilyName cf 2023-07-16 22:11:39,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:39,125 INFO [StoreOpener-4c83b35e51e4b8b4af719e98ccaf9143-1] regionserver.HStore(310): Store=4c83b35e51e4b8b4af719e98ccaf9143/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:11:39,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:39,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:39,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:39,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:11:39,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:11:39,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:39,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 140e6d510fc8fd283891fd8a58f95889; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69386091, jitterRate=0.03393332660198212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:39,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 140e6d510fc8fd283891fd8a58f95889: 2023-07-16 22:11:39,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889., pid=46, masterSystemTime=1689545499110 2023-07-16 22:11:39,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:11:39,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c83b35e51e4b8b4af719e98ccaf9143; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61489642, jitterRate=-0.08373293280601501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:11:39,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c83b35e51e4b8b4af719e98ccaf9143: 2023-07-16 22:11:39,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143., pid=45, masterSystemTime=1689545499110 2023-07-16 22:11:39,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=140e6d510fc8fd283891fd8a58f95889, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,137 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545499137"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545499137"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545499137"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545499137"}]},"ts":"1689545499137"} 2023-07-16 22:11:39,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:39,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:39,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=4c83b35e51e4b8b4af719e98ccaf9143, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545499139"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545499139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545499139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545499139"}]},"ts":"1689545499139"} 2023-07-16 22:11:39,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-16 22:11:39,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 140e6d510fc8fd283891fd8a58f95889, server=jenkins-hbase4.apache.org,41119,1689545452128 in 183 msec 2023-07-16 22:11:39,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=140e6d510fc8fd283891fd8a58f95889, ASSIGN in 344 msec 2023-07-16 22:11:39,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-16 22:11:39,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 4c83b35e51e4b8b4af719e98ccaf9143, server=jenkins-hbase4.apache.org,37353,1689545452057 in 185 msec 2023-07-16 22:11:39,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-16 22:11:39,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4c83b35e51e4b8b4af719e98ccaf9143, ASSIGN in 346 msec 2023-07-16 22:11:39,146 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:11:39,146 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545499146"}]},"ts":"1689545499146"} 2023-07-16 22:11:39,148 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-16 22:11:39,150 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:11:39,151 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-16 22:11:39,153 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 22:11:39,154 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:39,154 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:39,154 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:39,154 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:11:39,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:39,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:39,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:39,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 22:11:39,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 419 msec 2023-07-16 22:11:39,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 22:11:39,344 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-16 22:11:39,346 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 22:11:39,346 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,348 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:39,356 DEBUG [hconnection-0x8d80b2c-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:39,361 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:39,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:39,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545499365 (current time:1689545499365). 2023-07-16 22:11:39,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:39,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x1274686f to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:39,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56890f06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:39,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:39,376 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:39,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1274686f to 127.0.0.1:58223 2023-07-16 22:11:39,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:39,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x15acaf18 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:39,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24aa8ad2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:39,385 DEBUG [hconnection-0x3ac5407e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:39,388 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:39,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:39,393 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:39,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15acaf18 to 127.0.0.1:58223 2023-07-16 22:11:39,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:39,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 22:11:39,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:39,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:39,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:39,398 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:39,399 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689546099399 2023-07-16 22:11:39,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:39,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 22:11:39,401 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:39,401 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:39,402 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:39,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:39,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-16 22:11:39,404 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:39,405 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689546099405 2023-07-16 22:11:39,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,418 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-16 22:11:39,418 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:39,419 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 22:11:39,419 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 22:11:39,419 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,419 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,422 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,422 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,422 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,423 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,423 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:39,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,424 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:39,424 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:39,424 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,424 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:39,425 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:39,425 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:39,429 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:39,429 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:39,429 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:39,431 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,431 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:39,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 22:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a51a325[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 22:11:39,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a51a325[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:39,436 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 22:11:39,436 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:39,437 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:39,437 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:39,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:11:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,437 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:39,437 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,438 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:39,437 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:39,438 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. started... 2023-07-16 22:11:39,438 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:39,438 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,438 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. started... 2023-07-16 22:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c83b35e51e4b8b4af719e98ccaf9143: 2023-07-16 22:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 140e6d510fc8fd283891fd8a58f95889: 2023-07-16 22:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:11:39,445 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:39,445 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:39,445 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:39,451 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. completed. 2023-07-16 22:11:39,451 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:39,451 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:11:39,453 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. completed. 2023-07-16 22:11:39,453 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,453 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:39,453 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:39,453 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,453 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:39,453 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:11:39,453 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:39,453 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,453 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,454 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:39,456 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,456 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:39,456 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37353,1689545452057': 2023-07-16 22:11:39,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 22:11:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41119,1689545452128': 2023-07-16 22:11:39,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 22:11:39,464 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-16 22:11:39,464 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:39,464 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:39,464 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,464 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:39,466 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,466 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,467 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,468 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,468 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,470 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,471 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,471 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,475 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,475 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:39,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-16 22:11:39,475 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:11:39,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,476 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,478 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,478 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,478 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,478 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,478 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,478 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,478 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 22:11:39,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,501 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:39,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 22:11:39,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:39,502 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:39,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 22:11:39,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,527 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 22:11:39,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689545499400Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689545499487 (+87 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689545499487Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689545499487Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689545499490 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689545499498 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689545499527 (+29 ms) 2023-07-16 22:11:39,532 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:39,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 132 msec 2023-07-16 22:11:39,702 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:39,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 22:11:39,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:39,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41119] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:39,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37353] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:11:39,710 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 22:11:39,710 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,710 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:11:39,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:39,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545499721 (current time:1689545499721). 2023-07-16 22:11:39,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:11:39,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x4ce80466 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:39,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47ad3131, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:39,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:39,736 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:39,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ce80466 to 127.0.0.1:58223 2023-07-16 22:11:39,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:39,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x646c16e0 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:11:39,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68abf53f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:11:39,745 DEBUG [hconnection-0x462175a2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:39,747 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:39,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:11:39,752 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:11:39,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x646c16e0 to 127.0.0.1:58223 2023-07-16 22:11:39,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:11:39,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 22:11:39,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:11:39,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:39,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:39,757 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:39,758 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689546099758 2023-07-16 22:11:39,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 22:11:39,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 22:11:39,759 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:11:39,759 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:11:39,760 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 22:11:39,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:39,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-16 22:11:39,762 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:39,763 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689546099763 2023-07-16 22:11:39,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-16 22:11:39,772 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-16 22:11:39,772 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:39,773 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 22:11:39,773 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 22:11:39,774 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,774 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,775 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,775 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,775 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,775 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,775 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,776 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,776 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,776 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:11:39,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 22:11:39,777 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:39,777 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:39,777 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:39,777 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 22:11:39,779 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:39,779 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 22:11:39,779 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:11:39,779 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 22:11:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:39,779 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 22:11:39,780 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 22:11:39,782 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,782 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,783 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,783 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,783 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,783 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,783 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,785 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,785 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,786 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,786 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:11:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 22:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707a992b[Count = 1] remaining members to acquire global barrier 2023-07-16 22:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 22:11:39,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707a992b[Count = 0] remaining members to acquire global barrier 2023-07-16 22:11:39,789 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 22:11:39,789 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,790 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,790 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,790 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:39,791 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:39,791 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,791 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:11:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:11:39,791 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. started... 2023-07-16 22:11:39,791 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,791 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:11:39,792 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. started... 2023-07-16 22:11:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 22:11:39,792 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:39,792 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:11:39,792 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 140e6d510fc8fd283891fd8a58f95889 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 22:11:39,792 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4c83b35e51e4b8b4af719e98ccaf9143 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 22:11:39,794 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:39,794 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:39,794 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:39,819 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716eb6462dd675c4d86802135f9cfda7632 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716eb6462dd675c4d86802135f9cfda7632 2023-07-16 22:11:39,822 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307167605062595804c03a58a2506be74b82c to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307167605062595804c03a58a2506be74b82c 2023-07-16 22:11:39,830 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/.tmp/cf/567009e53fe04fbfa51416d1b7c38418 2023-07-16 22:11:39,835 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/.tmp/cf/36d1df6b64884c048576ac4017247bac 2023-07-16 22:11:39,837 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/.tmp/cf/567009e53fe04fbfa51416d1b7c38418 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf/567009e53fe04fbfa51416d1b7c38418 2023-07-16 22:11:39,845 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/.tmp/cf/36d1df6b64884c048576ac4017247bac as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf/36d1df6b64884c048576ac4017247bac 2023-07-16 22:11:39,847 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf/567009e53fe04fbfa51416d1b7c38418, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 22:11:39,849 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 140e6d510fc8fd283891fd8a58f95889 in 57ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:39,849 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 22:11:39,850 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 140e6d510fc8fd283891fd8a58f95889: 2023-07-16 22:11:39,850 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:39,850 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:39,850 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf/567009e53fe04fbfa51416d1b7c38418] hfiles 2023-07-16 22:11:39,850 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf/567009e53fe04fbfa51416d1b7c38418 for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:39,855 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf/36d1df6b64884c048576ac4017247bac, entries=47, sequenceid=6, filesize=12.7 K 2023-07-16 22:11:39,856 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 4c83b35e51e4b8b4af719e98ccaf9143 in 64ms, sequenceid=6, compaction requested=false 2023-07-16 22:11:39,857 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c83b35e51e4b8b4af719e98ccaf9143: 2023-07-16 22:11:39,858 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:39,858 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:11:39,858 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf/36d1df6b64884c048576ac4017247bac] hfiles 2023-07-16 22:11:39,858 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf/36d1df6b64884c048576ac4017247bac for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:39,860 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. completed. 2023-07-16 22:11:39,860 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:11:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:11:39,862 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:39,863 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 22:11:39,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:11:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,865 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:11:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,867 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. completed. 2023-07-16 22:11:39,867 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:11:39,867 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:11:39,867 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:11:39,867 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,867 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 22:11:39,867 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:11:39,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41119,1689545452128': 2023-07-16 22:11:39,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 22:11:39,870 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,870 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 22:11:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,870 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:39,870 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 22:11:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37353,1689545452057': 2023-07-16 22:11:39,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 22:11:39,875 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-16 22:11:39,875 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:11:39,875 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:11:39,875 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-16 22:11:39,875 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:11:39,877 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,877 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,877 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:11:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:11:39,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,877 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,877 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,877 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,877 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:11:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,878 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,878 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,879 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:11:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 22:11:39,880 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,881 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,881 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,892 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,892 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,892 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,892 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:11:39,892 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,892 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:11:39,894 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:11:39,892 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-16 22:11:39,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,892 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-16 22:11:39,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:11:39,894 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 22:11:39,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,894 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:11:39,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:11:39,894 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:11:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:11:39,895 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:11:39,895 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,895 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:11:39,895 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:11:39,895 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,895 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307167605062595804c03a58a2506be74b82c, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716eb6462dd675c4d86802135f9cfda7632] mob files 2023-07-16 22:11:39,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307167605062595804c03a58a2506be74b82c 2023-07-16 22:11:39,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716eb6462dd675c4d86802135f9cfda7632 2023-07-16 22:11:39,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-16 22:11:39,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 22:11:39,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,945 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:39,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689545499758Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689545499906 (+148 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689545499906Loading Region manifests for snaptb0-testConsecutiveExports at 1689545499907 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689545499910 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689545499919 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689545499945 (+26 ms) 2023-07-16 22:11:39,948 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 22:11:39,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 189 msec 2023-07-16 22:11:40,065 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:11:40,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 22:11:40,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:11:40,066 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066 2023-07-16 22:11:40,067 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066, srcFsUri=hdfs://localhost:38033, srcDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:11:40,090 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:11:40,090 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5c0b46e5, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:40,090 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6, snapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 22:11:40,100 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:40,115 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,116 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,116 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,117 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,117 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,117 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,117 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,188 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop-5168675669947555361.jar 2023-07-16 22:11:40,188 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,189 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,189 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,189 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,190 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,190 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:40,190 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:11:40,191 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:11:40,191 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:11:40,192 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:11:40,192 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:11:40,192 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:11:40,193 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:11:40,193 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:11:40,193 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:11:40,194 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:11:40,194 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:40,194 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:40,195 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:40,195 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:40,195 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:40,196 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:40,196 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:40,608 WARN [Listener at jenkins-hbase4.apache.org/36941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:11:40,610 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 22:11:40,612 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-16 22:11:42,629 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:42,629 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:42,633 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0002_000001 (auth:SIMPLE) 2023-07-16 22:11:43,033 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:44,057 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:11:47,467 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:49,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:52,947 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:54,803 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:11:54,804 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:11:54,808 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 22:11:54,808 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:11:54,808 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:11:54,809 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:11:54,811 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 22:11:54,811 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 22:11:54,811 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@430a8eed in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:11:54,811 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 22:11:54,811 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 22:11:54,812 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066, srcFsUri=hdfs://localhost:38033, srcDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:11:54,834 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:11:54,834 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5c17a537, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:54,834 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6, snapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 22:11:54,845 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 22:11:54,857 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,858 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,858 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,859 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,859 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,859 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,860 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,930 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop-3962944611375716126.jar 2023-07-16 22:11:54,931 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,931 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,932 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,932 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,932 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,933 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:11:54,933 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:11:54,933 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:11:54,934 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:11:54,934 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:11:54,935 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:11:54,935 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:11:54,935 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:11:54,936 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:11:54,936 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:11:54,936 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:11:54,937 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:54,937 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:54,938 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:54,938 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:54,938 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:11:54,938 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:54,939 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:11:55,310 WARN [Listener at jenkins-hbase4.apache.org/36941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:11:55,312 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 22:11:55,314 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-16 22:11:59,121 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:59,121 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:11:59,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0003_000001 (auth:SIMPLE) 2023-07-16 22:11:59,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:04,604 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:07,076 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:10,863 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:12,074 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:12:12,074 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:12:12,078 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 22:12:12,078 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:12:12,079 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:12:12,079 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:12:12,082 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 22:12:12,082 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 22:12:12,082 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@430a8eed in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 22:12:12,083 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 22:12:12,083 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/local-export-1689545500066/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 22:12:12,139 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-16 22:12:12,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-16 22:12:12,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:12,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 22:12:12,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545532146"}]},"ts":"1689545532146"} 2023-07-16 22:12:12,149 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-16 22:12:12,150 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-16 22:12:12,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=140e6d510fc8fd283891fd8a58f95889, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4c83b35e51e4b8b4af719e98ccaf9143, UNASSIGN}] 2023-07-16 22:12:12,154 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=140e6d510fc8fd283891fd8a58f95889, UNASSIGN 2023-07-16 22:12:12,155 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4c83b35e51e4b8b4af719e98ccaf9143, UNASSIGN 2023-07-16 22:12:12,155 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=140e6d510fc8fd283891fd8a58f95889, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:12,155 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=4c83b35e51e4b8b4af719e98ccaf9143, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:12,156 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545532155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545532155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545532155"}]},"ts":"1689545532155"} 2023-07-16 22:12:12,156 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545532155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545532155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545532155"}]},"ts":"1689545532155"} 2023-07-16 22:12:12,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 140e6d510fc8fd283891fd8a58f95889, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:12:12,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 4c83b35e51e4b8b4af719e98ccaf9143, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:12:12,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 22:12:12,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:12:12,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 140e6d510fc8fd283891fd8a58f95889, disabling compactions & flushes 2023-07-16 22:12:12,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:12:12,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:12:12,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. after waiting 0 ms 2023-07-16 22:12:12,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:12:12,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:12:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c83b35e51e4b8b4af719e98ccaf9143, disabling compactions & flushes 2023-07-16 22:12:12,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:12:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:12:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. after waiting 0 ms 2023-07-16 22:12:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:12:12,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:12,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:12,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:12,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:12,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143. 2023-07-16 22:12:12,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c83b35e51e4b8b4af719e98ccaf9143: 2023-07-16 22:12:12,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889. 2023-07-16 22:12:12,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 140e6d510fc8fd283891fd8a58f95889: 2023-07-16 22:12:12,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:12:12,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=4c83b35e51e4b8b4af719e98ccaf9143, regionState=CLOSED 2023-07-16 22:12:12,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545532348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545532348"}]},"ts":"1689545532348"} 2023-07-16 22:12:12,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:12:12,349 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=140e6d510fc8fd283891fd8a58f95889, regionState=CLOSED 2023-07-16 22:12:12,349 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689545532349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545532349"}]},"ts":"1689545532349"} 2023-07-16 22:12:12,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-16 22:12:12,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 4c83b35e51e4b8b4af719e98ccaf9143, server=jenkins-hbase4.apache.org,37353,1689545452057 in 182 msec 2023-07-16 22:12:12,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4c83b35e51e4b8b4af719e98ccaf9143, UNASSIGN in 201 msec 2023-07-16 22:12:12,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-16 22:12:12,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 140e6d510fc8fd283891fd8a58f95889, server=jenkins-hbase4.apache.org,41119,1689545452128 in 193 msec 2023-07-16 22:12:12,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-16 22:12:12,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=140e6d510fc8fd283891fd8a58f95889, UNASSIGN in 205 msec 2023-07-16 22:12:12,360 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545532360"}]},"ts":"1689545532360"} 2023-07-16 22:12:12,361 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-16 22:12:12,363 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-16 22:12:12,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 225 msec 2023-07-16 22:12:12,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 22:12:12,448 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-16 22:12:12,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-16 22:12:12,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:12,454 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:12,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-16 22:12:12,455 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:12,458 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-16 22:12:12,461 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:12,461 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:12,461 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:12,461 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:12,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 22:12:12,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 22:12:12,462 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:12:12,462 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:12:12,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 22:12:12,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 22:12:12,464 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:12,464 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:12,464 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:12,464 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:12,464 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:12,464 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 22:12:12,464 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:12,464 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:12,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 22:12:12,465 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/recovered.edits] 2023-07-16 22:12:12,466 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/recovered.edits] 2023-07-16 22:12:12,473 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf/567009e53fe04fbfa51416d1b7c38418 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/cf/567009e53fe04fbfa51416d1b7c38418 2023-07-16 22:12:12,473 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf/36d1df6b64884c048576ac4017247bac to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/cf/36d1df6b64884c048576ac4017247bac 2023-07-16 22:12:12,477 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889/recovered.edits/9.seqid 2023-07-16 22:12:12,477 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143/recovered.edits/9.seqid 2023-07-16 22:12:12,477 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/140e6d510fc8fd283891fd8a58f95889 2023-07-16 22:12:12,478 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testConsecutiveExports/4c83b35e51e4b8b4af719e98ccaf9143 2023-07-16 22:12:12,478 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 22:12:12,479 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-16 22:12:12,479 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-16 22:12:12,483 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307167605062595804c03a58a2506be74b82c to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307167605062595804c03a58a2506be74b82c 2023-07-16 22:12:12,484 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716eb6462dd675c4d86802135f9cfda7632 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716eb6462dd675c4d86802135f9cfda7632 2023-07-16 22:12:12,485 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-16 22:12:12,488 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:12,493 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-16 22:12:12,495 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-16 22:12:12,496 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:12,496 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-16 22:12:12,496 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545532496"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:12,497 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545532496"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:12,499 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:12:12,499 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 140e6d510fc8fd283891fd8a58f95889, NAME => 'testtb-testConsecutiveExports,,1689545498735.140e6d510fc8fd283891fd8a58f95889.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4c83b35e51e4b8b4af719e98ccaf9143, NAME => 'testtb-testConsecutiveExports,1,1689545498735.4c83b35e51e4b8b4af719e98ccaf9143.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:12:12,499 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-16 22:12:12,499 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545532499"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:12,501 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-16 22:12:12,504 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 22:12:12,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 55 msec 2023-07-16 22:12:12,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 22:12:12,568 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-16 22:12:12,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-16 22:12:12,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-16 22:12:12,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-16 22:12:12,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-16 22:12:12,632 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 757), OpenFileDescriptor=898 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 348) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2209 (was 2668) 2023-07-16 22:12:12,632 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-16 22:12:12,659 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=183, AvailableMemoryMB=2203 2023-07-16 22:12:12,659 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-16 22:12:12,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 22:12:12,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:12,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:12:12,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-16 22:12:12,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:12,666 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:12:12,671 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:12,675 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf empty. 2023-07-16 22:12:12,675 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:12,675 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:12,675 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7 empty. 2023-07-16 22:12:12,676 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:12,682 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 22:12:12,721 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-16 22:12:12,729 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 64ae9a4807159b91853b62198786b8b7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:12:12,729 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 03d9e97760bc5c418a444f4cb1ce13bf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:12:12,754 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:12,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 03d9e97760bc5c418a444f4cb1ce13bf, disabling compactions & flushes 2023-07-16 22:12:12,755 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:12,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:12,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. after waiting 0 ms 2023-07-16 22:12:12,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:12,755 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:12,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 03d9e97760bc5c418a444f4cb1ce13bf: 2023-07-16 22:12:12,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:12,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 64ae9a4807159b91853b62198786b8b7, disabling compactions & flushes 2023-07-16 22:12:12,766 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:12,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:12,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. after waiting 0 ms 2023-07-16 22:12:12,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:12,766 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:12,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 64ae9a4807159b91853b62198786b8b7: 2023-07-16 22:12:12,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:12:12,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:12,770 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545532769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545532769"}]},"ts":"1689545532769"} 2023-07-16 22:12:12,770 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545532769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545532769"}]},"ts":"1689545532769"} 2023-07-16 22:12:12,780 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:12:12,784 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:12:12,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545532784"}]},"ts":"1689545532784"} 2023-07-16 22:12:12,786 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-16 22:12:12,789 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:12:12,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:12:12,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:12:12,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:12:12,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:12:12,790 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=03d9e97760bc5c418a444f4cb1ce13bf, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=64ae9a4807159b91853b62198786b8b7, ASSIGN}] 2023-07-16 22:12:12,799 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=03d9e97760bc5c418a444f4cb1ce13bf, ASSIGN 2023-07-16 22:12:12,799 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=64ae9a4807159b91853b62198786b8b7, ASSIGN 2023-07-16 22:12:12,806 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=03d9e97760bc5c418a444f4cb1ce13bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38577,1689545452169; forceNewPlan=false, retain=false 2023-07-16 22:12:12,806 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=64ae9a4807159b91853b62198786b8b7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41119,1689545452128; forceNewPlan=false, retain=false 2023-07-16 22:12:12,957 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:12:12,960 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=64ae9a4807159b91853b62198786b8b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:12,960 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=03d9e97760bc5c418a444f4cb1ce13bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:12,960 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545532960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545532960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545532960"}]},"ts":"1689545532960"} 2023-07-16 22:12:12,960 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545532960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545532960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545532960"}]},"ts":"1689545532960"} 2023-07-16 22:12:12,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 64ae9a4807159b91853b62198786b8b7, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:12:12,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 03d9e97760bc5c418a444f4cb1ce13bf, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:12:12,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:13,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 64ae9a4807159b91853b62198786b8b7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:12:13,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. service=AccessControlService 2023-07-16 22:12:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03d9e97760bc5c418a444f4cb1ce13bf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:12:13,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. service=AccessControlService 2023-07-16 22:12:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:13,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:13,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:13,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:13,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:13,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:13,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:13,123 INFO [StoreOpener-64ae9a4807159b91853b62198786b8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:13,124 INFO [StoreOpener-03d9e97760bc5c418a444f4cb1ce13bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:13,126 DEBUG [StoreOpener-64ae9a4807159b91853b62198786b8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf 2023-07-16 22:12:13,126 DEBUG [StoreOpener-64ae9a4807159b91853b62198786b8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf 2023-07-16 22:12:13,126 DEBUG [StoreOpener-03d9e97760bc5c418a444f4cb1ce13bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf 2023-07-16 22:12:13,126 DEBUG [StoreOpener-03d9e97760bc5c418a444f4cb1ce13bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf 2023-07-16 22:12:13,127 INFO [StoreOpener-64ae9a4807159b91853b62198786b8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64ae9a4807159b91853b62198786b8b7 columnFamilyName cf 2023-07-16 22:12:13,127 INFO [StoreOpener-03d9e97760bc5c418a444f4cb1ce13bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03d9e97760bc5c418a444f4cb1ce13bf columnFamilyName cf 2023-07-16 22:12:13,128 INFO [StoreOpener-64ae9a4807159b91853b62198786b8b7-1] regionserver.HStore(310): Store=64ae9a4807159b91853b62198786b8b7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:13,128 INFO [StoreOpener-03d9e97760bc5c418a444f4cb1ce13bf-1] regionserver.HStore(310): Store=03d9e97760bc5c418a444f4cb1ce13bf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:13,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:13,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:13,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:13,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:13,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:13,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:13,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:13,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 64ae9a4807159b91853b62198786b8b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68695470, jitterRate=0.023642271757125854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:13,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 64ae9a4807159b91853b62198786b8b7: 2023-07-16 22:12:13,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7., pid=60, masterSystemTime=1689545533113 2023-07-16 22:12:13,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:13,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:13,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:13,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 03d9e97760bc5c418a444f4cb1ce13bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62273068, jitterRate=-0.07205897569656372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:13,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 03d9e97760bc5c418a444f4cb1ce13bf: 2023-07-16 22:12:13,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf., pid=61, masterSystemTime=1689545533114 2023-07-16 22:12:13,142 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=64ae9a4807159b91853b62198786b8b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,143 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545533142"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545533142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545533142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545533142"}]},"ts":"1689545533142"} 2023-07-16 22:12:13,144 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=03d9e97760bc5c418a444f4cb1ce13bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,144 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545533144"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545533144"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545533144"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545533144"}]},"ts":"1689545533144"} 2023-07-16 22:12:13,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-16 22:12:13,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-16 22:12:13,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 03d9e97760bc5c418a444f4cb1ce13bf, server=jenkins-hbase4.apache.org,38577,1689545452169 in 184 msec 2023-07-16 22:12:13,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 64ae9a4807159b91853b62198786b8b7, server=jenkins-hbase4.apache.org,41119,1689545452128 in 183 msec 2023-07-16 22:12:13,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=03d9e97760bc5c418a444f4cb1ce13bf, ASSIGN in 362 msec 2023-07-16 22:12:13,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-16 22:12:13,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=64ae9a4807159b91853b62198786b8b7, ASSIGN in 362 msec 2023-07-16 22:12:13,160 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:12:13,160 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545533160"}]},"ts":"1689545533160"} 2023-07-16 22:12:13,162 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-16 22:12:13,165 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:12:13,165 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-16 22:12:13,167 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 22:12:13,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:13,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:13,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:13,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:13,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,171 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:13,173 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 509 msec 2023-07-16 22:12:13,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 22:12:13,271 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-16 22:12:13,274 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,274 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,275 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:13,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:13,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545533290 (current time:1689545533290). 2023-07-16 22:12:13,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:13,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x28e00739 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:13,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2957b5d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:13,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:13,302 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:13,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28e00739 to 127.0.0.1:58223 2023-07-16 22:12:13,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:13,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x3d869d2b to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:13,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15778c6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:13,315 DEBUG [hconnection-0x11a7a19-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:13,316 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:13,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:13,324 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:13,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d869d2b to 127.0.0.1:58223 2023-07-16 22:12:13,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:13,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 22:12:13,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:13,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:13,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:13,330 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:13,331 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689546133331 2023-07-16 22:12:13,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:13,331 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,332 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:13,332 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:13,333 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:13,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:13,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-16 22:12:13,336 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:13,337 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689546133337 2023-07-16 22:12:13,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,359 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 22:12:13,359 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:13,360 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 22:12:13,360 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 22:12:13,361 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,361 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,362 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,362 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,362 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,362 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,363 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,363 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,363 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,363 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:13,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 22:12:13,364 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:13,364 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:13,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:13,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,367 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:13,368 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:13,368 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:13,368 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:13,368 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:13,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,369 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:13,369 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:13,369 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:13,369 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:13,370 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:13,370 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:13,370 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:13,370 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:13,376 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,376 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,377 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,377 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,377 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,377 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:13,377 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,378 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,378 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:13,378 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,378 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:13,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 22:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d4418c[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 22:12:13,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d4418c[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:13,383 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 22:12:13,383 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,384 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,384 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:13,384 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:13,385 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:12:13,385 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,386 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:13,386 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:13,386 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:13,386 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,386 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. started... 2023-07-16 22:12:13,386 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 03d9e97760bc5c418a444f4cb1ce13bf: 2023-07-16 22:12:13,386 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,387 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,387 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:13,387 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:13,390 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,391 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:13,391 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:13,391 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:13,391 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:13,391 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. started... 2023-07-16 22:12:13,393 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 64ae9a4807159b91853b62198786b8b7: 2023-07-16 22:12:13,393 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,393 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:13,393 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:13,393 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:13,393 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:13,393 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,394 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:13,393 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:13,412 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. completed. 2023-07-16 22:12:13,412 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,412 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:13,412 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:13,412 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,412 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:13,412 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:12:13,414 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,415 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:13,415 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:13,415 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:13,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,419 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. completed. 2023-07-16 22:12:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,419 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:12:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,421 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,422 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:13,422 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:13,422 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 22:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41119,1689545452128': 2023-07-16 22:12:13,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 22:12:13,432 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 22:12:13,432 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:13,432 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:13,432 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,432 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:13,432 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:13,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:13,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:13,435 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:13,436 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,436 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,436 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,436 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,436 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,436 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,437 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,438 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,439 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,440 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,442 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,442 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,443 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,451 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:13,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:12:13,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,451 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,454 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,454 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,455 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,455 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,455 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,455 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,455 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,455 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 22:12:13,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 22:12:13,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,534 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689545533331Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689545533478 (+147 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689545533478Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689545533478Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689545533482 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689545533491 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689545533533 (+42 ms) 2023-07-16 22:12:13,537 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:13,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 205 msec 2023-07-16 22:12:13,635 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:13,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:13,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:13,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:13,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41119] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:13,643 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,643 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,643 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:13,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:13,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545533653 (current time:1689545533653). 2023-07-16 22:12:13,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:13,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x3cbef4be to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:13,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cb7d0b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:13,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:13,666 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:13,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cbef4be to 127.0.0.1:58223 2023-07-16 22:12:13,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:13,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x5a0f1562 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:13,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11df0199, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:13,683 DEBUG [hconnection-0x334f3903-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:13,688 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:13,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:13,699 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:13,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a0f1562 to 127.0.0.1:58223 2023-07-16 22:12:13,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:13,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 22:12:13,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:13,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:13,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:13,706 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:13,707 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689546133707 2023-07-16 22:12:13,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 22:12:13,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,710 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:13,710 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:13,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:13,712 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 22:12:13,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-16 22:12:13,715 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:13,717 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689546133717 2023-07-16 22:12:13,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,740 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 22:12:13,740 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:13,742 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 22:12:13,742 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 22:12:13,805 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,805 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,807 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,807 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,807 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,807 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,808 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,808 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,808 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,809 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 22:12:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,810 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 22:12:13,810 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:13,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 22:12:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,811 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:13,811 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:13,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 22:12:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:13,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:13,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,814 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:13,814 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 22:12:13,814 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:13,814 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:13,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:13,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:13,816 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:13,816 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 22:12:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 22:12:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 22:12:13,817 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:13,818 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,820 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,820 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,820 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,821 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:13,821 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,821 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,821 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,821 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:13,822 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,822 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 22:12:13,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b5e347[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:13,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 22:12:13,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b5e347[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:13,826 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 22:12:13,826 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,827 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,827 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,827 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,828 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:13,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:12:13,828 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:13,828 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. started... 2023-07-16 22:12:13,828 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,829 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:13,828 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:13,829 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 03d9e97760bc5c418a444f4cb1ce13bf 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 22:12:13,828 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:13,829 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. started... 2023-07-16 22:12:13,829 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 64ae9a4807159b91853b62198786b8b7 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 22:12:13,830 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:13,830 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:13,830 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:13,868 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716d952f5e98111426095fcab87b4fd61bd to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d952f5e98111426095fcab87b4fd61bd 2023-07-16 22:12:13,869 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307169197a332ceb3463898a837aee4ecdb76 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307169197a332ceb3463898a837aee4ecdb76 2023-07-16 22:12:13,896 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/.tmp/cf/fa2b66333a784cd9a48ad4bb1bc63af1 2023-07-16 22:12:13,898 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/.tmp/cf/a521201d249a49ec8bce6056c7edf20f 2023-07-16 22:12:13,904 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/.tmp/cf/a521201d249a49ec8bce6056c7edf20f as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf/a521201d249a49ec8bce6056c7edf20f 2023-07-16 22:12:13,911 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/.tmp/cf/fa2b66333a784cd9a48ad4bb1bc63af1 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf/fa2b66333a784cd9a48ad4bb1bc63af1 2023-07-16 22:12:13,912 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf/a521201d249a49ec8bce6056c7edf20f, entries=45, sequenceid=6, filesize=13.2 K 2023-07-16 22:12:13,913 INFO [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 64ae9a4807159b91853b62198786b8b7 in 84ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:13,913 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-16 22:12:13,914 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 64ae9a4807159b91853b62198786b8b7: 2023-07-16 22:12:13,914 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,915 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:13,915 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf/a521201d249a49ec8bce6056c7edf20f] hfiles 2023-07-16 22:12:13,915 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf/a521201d249a49ec8bce6056c7edf20f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,920 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf/fa2b66333a784cd9a48ad4bb1bc63af1, entries=5, sequenceid=6, filesize=5.8 K 2023-07-16 22:12:13,923 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 03d9e97760bc5c418a444f4cb1ce13bf in 94ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:13,924 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 03d9e97760bc5c418a444f4cb1ce13bf: 2023-07-16 22:12:13,925 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,925 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:13,925 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf/fa2b66333a784cd9a48ad4bb1bc63af1] hfiles 2023-07-16 22:12:13,925 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf/fa2b66333a784cd9a48ad4bb1bc63af1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,935 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. completed. 2023-07-16 22:12:13,935 DEBUG [rs(jenkins-hbase4.apache.org,41119,1689545452128)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:13,935 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:13,935 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:13,935 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,935 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:13,935 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:12:13,939 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:13,939 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,939 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:13,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,940 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:13,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41119,1689545452128': 2023-07-16 22:12:13,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 22:12:13,958 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. completed. 2023-07-16 22:12:13,958 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:13,958 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:13,958 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:13,958 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,958 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 22:12:13,958 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:12:13,960 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,960 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 22:12:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,960 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:13,961 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 22:12:13,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:12:13,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 22:12:13,979 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 22:12:13,979 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:13,979 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:13,979 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,979 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:13,986 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:13,987 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,987 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,987 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,988 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:13,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,990 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,991 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,993 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,994 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,994 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,997 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:13,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:13,998 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:13,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:13,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:13,999 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:13,998 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:14,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:14,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:14,001 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:13,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:14,001 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:14,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:12:14,001 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:14,001 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:14,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:14,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307169197a332ceb3463898a837aee4ecdb76, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d952f5e98111426095fcab87b4fd61bd] mob files 2023-07-16 22:12:14,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307169197a332ceb3463898a837aee4ecdb76 2023-07-16 22:12:14,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d952f5e98111426095fcab87b4fd61bd 2023-07-16 22:12:14,018 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:14,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:14,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:14,019 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:14,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:14,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:14,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:14,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 22:12:14,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:14,192 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:14,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689545533708Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689545534044 (+336 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689545534044Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689545534045 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689545534096 (+51 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689545534155 (+59 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689545534192 (+37 ms) 2023-07-16 22:12:14,196 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 22:12:14,198 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 486 msec 2023-07-16 22:12:14,320 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:14,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 22:12:14,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:14,358 DEBUG [Listener at jenkins-hbase4.apache.org/36941] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:12:14,362 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:12:14,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37353] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 22:12:14,364 DEBUG [Listener at jenkins-hbase4.apache.org/36941] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:12:14,368 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:12:14,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38577] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 22:12:14,369 DEBUG [Listener at jenkins-hbase4.apache.org/36941] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 22:12:14,373 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 22:12:14,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41119] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 22:12:14,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 22:12:14,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:14,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:12:14,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-16 22:12:14,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:12:14,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 22:12:14,387 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,390 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea empty. 2023-07-16 22:12:14,390 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,391 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,391 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f empty. 2023-07-16 22:12:14,392 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,392 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 22:12:14,410 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-16 22:12:14,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 442aa1bd5dd75de03dc66678fdb7f77f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:12:14,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f0030ac784fcf392f31330654d0ff1ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:12:14,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:14,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 442aa1bd5dd75de03dc66678fdb7f77f, disabling compactions & flushes 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f0030ac784fcf392f31330654d0ff1ea, disabling compactions & flushes 2023-07-16 22:12:14,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:14,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. after waiting 0 ms 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:14,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. after waiting 0 ms 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 442aa1bd5dd75de03dc66678fdb7f77f: 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:14,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:14,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f0030ac784fcf392f31330654d0ff1ea: 2023-07-16 22:12:14,426 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:12:14,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545534427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545534427"}]},"ts":"1689545534427"} 2023-07-16 22:12:14,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545534427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545534427"}]},"ts":"1689545534427"} 2023-07-16 22:12:14,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:12:14,430 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:12:14,430 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545534430"}]},"ts":"1689545534430"} 2023-07-16 22:12:14,432 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-16 22:12:14,436 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:12:14,437 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:12:14,437 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:12:14,437 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:12:14,438 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:12:14,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0030ac784fcf392f31330654d0ff1ea, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=442aa1bd5dd75de03dc66678fdb7f77f, ASSIGN}] 2023-07-16 22:12:14,441 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0030ac784fcf392f31330654d0ff1ea, ASSIGN 2023-07-16 22:12:14,441 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=442aa1bd5dd75de03dc66678fdb7f77f, ASSIGN 2023-07-16 22:12:14,442 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=442aa1bd5dd75de03dc66678fdb7f77f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41119,1689545452128; forceNewPlan=false, retain=false 2023-07-16 22:12:14,442 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0030ac784fcf392f31330654d0ff1ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37353,1689545452057; forceNewPlan=false, retain=false 2023-07-16 22:12:14,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 22:12:14,592 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:12:14,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=442aa1bd5dd75de03dc66678fdb7f77f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:14,595 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f0030ac784fcf392f31330654d0ff1ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:14,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545534595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545534595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545534595"}]},"ts":"1689545534595"} 2023-07-16 22:12:14,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545534595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545534595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545534595"}]},"ts":"1689545534595"} 2023-07-16 22:12:14,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 442aa1bd5dd75de03dc66678fdb7f77f, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:12:14,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure f0030ac784fcf392f31330654d0ff1ea, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:12:14,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 22:12:14,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:14,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0030ac784fcf392f31330654d0ff1ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.', STARTKEY => '', ENDKEY => '2'} 2023-07-16 22:12:14,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. service=AccessControlService 2023-07-16 22:12:14,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:14,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:14,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:14,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 442aa1bd5dd75de03dc66678fdb7f77f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.', STARTKEY => '2', ENDKEY => ''} 2023-07-16 22:12:14,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. service=AccessControlService 2023-07-16 22:12:14,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:14,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:14,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,759 INFO [StoreOpener-f0030ac784fcf392f31330654d0ff1ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,759 INFO [StoreOpener-442aa1bd5dd75de03dc66678fdb7f77f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,761 DEBUG [StoreOpener-442aa1bd5dd75de03dc66678fdb7f77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf 2023-07-16 22:12:14,761 DEBUG [StoreOpener-442aa1bd5dd75de03dc66678fdb7f77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf 2023-07-16 22:12:14,761 INFO [StoreOpener-442aa1bd5dd75de03dc66678fdb7f77f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 442aa1bd5dd75de03dc66678fdb7f77f columnFamilyName cf 2023-07-16 22:12:14,762 INFO [StoreOpener-442aa1bd5dd75de03dc66678fdb7f77f-1] regionserver.HStore(310): Store=442aa1bd5dd75de03dc66678fdb7f77f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:14,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,764 DEBUG [StoreOpener-f0030ac784fcf392f31330654d0ff1ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf 2023-07-16 22:12:14,764 DEBUG [StoreOpener-f0030ac784fcf392f31330654d0ff1ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf 2023-07-16 22:12:14,765 INFO [StoreOpener-f0030ac784fcf392f31330654d0ff1ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0030ac784fcf392f31330654d0ff1ea columnFamilyName cf 2023-07-16 22:12:14,765 INFO [StoreOpener-f0030ac784fcf392f31330654d0ff1ea-1] regionserver.HStore(310): Store=f0030ac784fcf392f31330654d0ff1ea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:14,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:14,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:14,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 442aa1bd5dd75de03dc66678fdb7f77f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59059981, jitterRate=-0.1199377030134201}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:14,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:14,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 442aa1bd5dd75de03dc66678fdb7f77f: 2023-07-16 22:12:14,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f., pid=69, masterSystemTime=1689545534751 2023-07-16 22:12:14,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:14,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:14,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:14,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f0030ac784fcf392f31330654d0ff1ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62729527, jitterRate=-0.06525720655918121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:14,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f0030ac784fcf392f31330654d0ff1ea: 2023-07-16 22:12:14,773 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=442aa1bd5dd75de03dc66678fdb7f77f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:14,773 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545534773"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545534773"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545534773"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545534773"}]},"ts":"1689545534773"} 2023-07-16 22:12:14,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea., pid=70, masterSystemTime=1689545534751 2023-07-16 22:12:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:14,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:14,776 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f0030ac784fcf392f31330654d0ff1ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:14,776 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545534775"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545534775"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545534775"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545534775"}]},"ts":"1689545534775"} 2023-07-16 22:12:14,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-16 22:12:14,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 442aa1bd5dd75de03dc66678fdb7f77f, server=jenkins-hbase4.apache.org,41119,1689545452128 in 178 msec 2023-07-16 22:12:14,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=442aa1bd5dd75de03dc66678fdb7f77f, ASSIGN in 339 msec 2023-07-16 22:12:14,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-16 22:12:14,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure f0030ac784fcf392f31330654d0ff1ea, server=jenkins-hbase4.apache.org,37353,1689545452057 in 179 msec 2023-07-16 22:12:14,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-16 22:12:14,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0030ac784fcf392f31330654d0ff1ea, ASSIGN in 346 msec 2023-07-16 22:12:14,786 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:12:14,786 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545534786"}]},"ts":"1689545534786"} 2023-07-16 22:12:14,787 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-16 22:12:14,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:12:14,790 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-16 22:12:14,792 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 22:12:14,794 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:14,794 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:14,794 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:14,794 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:14,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:14,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:14,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:14,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:14,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:14,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:14,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:14,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:14,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 419 msec 2023-07-16 22:12:14,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 22:12:14,985 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-16 22:12:15,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions f0030ac784fcf392f31330654d0ff1ea, 442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:15,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0030ac784fcf392f31330654d0ff1ea, 442aa1bd5dd75de03dc66678fdb7f77f], force=true 2023-07-16 22:12:15,032 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0030ac784fcf392f31330654d0ff1ea, 442aa1bd5dd75de03dc66678fdb7f77f], force=true 2023-07-16 22:12:15,032 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0030ac784fcf392f31330654d0ff1ea, 442aa1bd5dd75de03dc66678fdb7f77f], force=true 2023-07-16 22:12:15,032 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0030ac784fcf392f31330654d0ff1ea, 442aa1bd5dd75de03dc66678fdb7f77f], force=true 2023-07-16 22:12:15,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:15,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0030ac784fcf392f31330654d0ff1ea, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=442aa1bd5dd75de03dc66678fdb7f77f, UNASSIGN}] 2023-07-16 22:12:15,062 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0030ac784fcf392f31330654d0ff1ea, UNASSIGN 2023-07-16 22:12:15,062 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=442aa1bd5dd75de03dc66678fdb7f77f, UNASSIGN 2023-07-16 22:12:15,063 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f0030ac784fcf392f31330654d0ff1ea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:15,063 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=442aa1bd5dd75de03dc66678fdb7f77f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:15,063 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545535063"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545535063"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545535063"}]},"ts":"1689545535063"} 2023-07-16 22:12:15,063 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545535063"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545535063"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545535063"}]},"ts":"1689545535063"} 2023-07-16 22:12:15,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure f0030ac784fcf392f31330654d0ff1ea, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:12:15,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 442aa1bd5dd75de03dc66678fdb7f77f, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:12:15,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:15,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:15,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f0030ac784fcf392f31330654d0ff1ea, disabling compactions & flushes 2023-07-16 22:12:15,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:15,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:15,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. after waiting 0 ms 2023-07-16 22:12:15,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:15,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f0030ac784fcf392f31330654d0ff1ea 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 22:12:15,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:15,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 442aa1bd5dd75de03dc66678fdb7f77f, disabling compactions & flushes 2023-07-16 22:12:15,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:15,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:15,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. after waiting 0 ms 2023-07-16 22:12:15,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:15,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 442aa1bd5dd75de03dc66678fdb7f77f 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 22:12:15,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/.tmp/cf/675672d3939e484c86b243fda5838eed 2023-07-16 22:12:15,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/.tmp/cf/675672d3939e484c86b243fda5838eed as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf/675672d3939e484c86b243fda5838eed 2023-07-16 22:12:15,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/.tmp/cf/adcec918128c4441a42745d79d8b60b3 2023-07-16 22:12:15,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf/675672d3939e484c86b243fda5838eed, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 22:12:15,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f0030ac784fcf392f31330654d0ff1ea in 35ms, sequenceid=5, compaction requested=false 2023-07-16 22:12:15,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 22:12:15,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/.tmp/cf/adcec918128c4441a42745d79d8b60b3 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf/adcec918128c4441a42745d79d8b60b3 2023-07-16 22:12:15,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 22:12:15,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:15,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea. 2023-07-16 22:12:15,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f0030ac784fcf392f31330654d0ff1ea: 2023-07-16 22:12:15,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf/adcec918128c4441a42745d79d8b60b3, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 22:12:15,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:15,264 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f0030ac784fcf392f31330654d0ff1ea, regionState=CLOSED 2023-07-16 22:12:15,264 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545535264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545535264"}]},"ts":"1689545535264"} 2023-07-16 22:12:15,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 442aa1bd5dd75de03dc66678fdb7f77f in 43ms, sequenceid=5, compaction requested=false 2023-07-16 22:12:15,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-16 22:12:15,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure f0030ac784fcf392f31330654d0ff1ea, server=jenkins-hbase4.apache.org,37353,1689545452057 in 205 msec 2023-07-16 22:12:15,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 22:12:15,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:15,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f. 2023-07-16 22:12:15,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 442aa1bd5dd75de03dc66678fdb7f77f: 2023-07-16 22:12:15,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0030ac784fcf392f31330654d0ff1ea, UNASSIGN in 216 msec 2023-07-16 22:12:15,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:15,277 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=442aa1bd5dd75de03dc66678fdb7f77f, regionState=CLOSED 2023-07-16 22:12:15,277 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689545535277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545535277"}]},"ts":"1689545535277"} 2023-07-16 22:12:15,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-16 22:12:15,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 442aa1bd5dd75de03dc66678fdb7f77f, server=jenkins-hbase4.apache.org,41119,1689545452128 in 213 msec 2023-07-16 22:12:15,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-16 22:12:15,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=442aa1bd5dd75de03dc66678fdb7f77f, UNASSIGN in 221 msec 2023-07-16 22:12:15,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:15,343 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-16 22:12:15,345 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534375.f0030ac784fcf392f31330654d0ff1ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:15,345 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689545534375.442aa1bd5dd75de03dc66678fdb7f77f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:15,345 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:15,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec51f740ffc8ad737758306011ae52ec, ASSIGN}] 2023-07-16 22:12:15,399 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec51f740ffc8ad737758306011ae52ec, ASSIGN 2023-07-16 22:12:15,400 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec51f740ffc8ad737758306011ae52ec, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37353,1689545452057; forceNewPlan=false, retain=false 2023-07-16 22:12:15,550 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 22:12:15,553 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ec51f740ffc8ad737758306011ae52ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:15,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689545535553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545535553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545535553"}]},"ts":"1689545535553"} 2023-07-16 22:12:15,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ec51f740ffc8ad737758306011ae52ec, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:12:15,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:15,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:15,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec51f740ffc8ad737758306011ae52ec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.', STARTKEY => '', ENDKEY => ''} 2023-07-16 22:12:15,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. service=AccessControlService 2023-07-16 22:12:15,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:15,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:15,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:15,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:15,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:15,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/.regioninfo 2023-07-16 22:12:15,729 INFO [StoreOpener-ec51f740ffc8ad737758306011ae52ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:15,731 DEBUG [StoreOpener-ec51f740ffc8ad737758306011ae52ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf 2023-07-16 22:12:15,731 DEBUG [StoreOpener-ec51f740ffc8ad737758306011ae52ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf 2023-07-16 22:12:15,731 INFO [StoreOpener-ec51f740ffc8ad737758306011ae52ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec51f740ffc8ad737758306011ae52ec columnFamilyName cf 2023-07-16 22:12:15,764 DEBUG [StoreOpener-ec51f740ffc8ad737758306011ae52ec-1] regionserver.HStore(539): loaded hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/675672d3939e484c86b243fda5838eed.f0030ac784fcf392f31330654d0ff1ea->hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf/675672d3939e484c86b243fda5838eed-top 2023-07-16 22:12:15,778 DEBUG [StoreOpener-ec51f740ffc8ad737758306011ae52ec-1] regionserver.HStore(539): loaded hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/adcec918128c4441a42745d79d8b60b3.442aa1bd5dd75de03dc66678fdb7f77f->hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf/adcec918128c4441a42745d79d8b60b3-top 2023-07-16 22:12:15,779 INFO [StoreOpener-ec51f740ffc8ad737758306011ae52ec-1] regionserver.HStore(310): Store=ec51f740ffc8ad737758306011ae52ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:15,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:15,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:15,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:15,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec51f740ffc8ad737758306011ae52ec; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70850879, jitterRate=0.05576036870479584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:15,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec51f740ffc8ad737758306011ae52ec: 2023-07-16 22:12:15,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec., pid=77, masterSystemTime=1689545535708 2023-07-16 22:12:15,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.,because compaction is disabled. 2023-07-16 22:12:15,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:15,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:15,798 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ec51f740ffc8ad737758306011ae52ec, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:15,798 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689545535798"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545535798"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545535798"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545535798"}]},"ts":"1689545535798"} 2023-07-16 22:12:15,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-16 22:12:15,804 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ec51f740ffc8ad737758306011ae52ec, server=jenkins-hbase4.apache.org,37353,1689545452057 in 244 msec 2023-07-16 22:12:15,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-16 22:12:15,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec51f740ffc8ad737758306011ae52ec, ASSIGN in 407 msec 2023-07-16 22:12:15,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0030ac784fcf392f31330654d0ff1ea, 442aa1bd5dd75de03dc66678fdb7f77f], force=true in 782 msec 2023-07-16 22:12:16,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 22:12:16,141 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-16 22:12:16,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 22:12:16,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545536142 (current time:1689545536142). 2023-07-16 22:12:16,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:16,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x58271486 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:16,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f113d40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:16,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:16,168 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:16,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58271486 to 127.0.0.1:58223 2023-07-16 22:12:16,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:16,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x6b63024c to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:16,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b00b882, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:16,203 DEBUG [hconnection-0x5dad7f9f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:16,208 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:16,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:16,216 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:16,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b63024c to 127.0.0.1:58223 2023-07-16 22:12:16,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:16,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 22:12:16,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:16,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 22:12:16,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 22:12:16,236 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 22:12:16,237 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689546136237 2023-07-16 22:12:16,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 22:12:16,237 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,237 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:16,238 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:16,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 22:12:16,257 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 22:12:16,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 32 msec 2023-07-16 22:12:16,260 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 22:12:16,261 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689546136261 2023-07-16 22:12:16,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,319 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 22:12:16,319 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:16,320 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-16 22:12:16,320 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-16 22:12:16,321 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,321 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,322 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:16,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,323 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 22:12:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 22:12:16,324 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,324 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:16,326 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:16,327 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:16,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:16,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 22:12:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 22:12:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 22:12:16,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 22:12:16,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,339 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 22:12:16,339 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:16,340 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:16,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 22:12:16,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:16,341 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:16,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,343 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 22:12:16,344 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:16,344 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 22:12:16,345 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 22:12:16,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,345 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 22:12:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 22:12:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 22:12:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 22:12:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 22:12:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:16,352 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 22:12:16,352 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 22:12:16,352 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 22:12:16,353 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,353 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:16,354 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,354 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:16,354 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,355 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,356 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:16,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-16 22:12:16,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@253a3cbf[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:16,357 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-16 22:12:16,357 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,358 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,359 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,359 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:12:16,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,360 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,360 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:12:16,360 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 22:12:16,362 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 22:12:16,362 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:16,363 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:16,363 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:16,362 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:16,363 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. started... 2023-07-16 22:12:16,363 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 22:12:16,364 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 22:12:16,364 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:16,364 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 22:12:16,369 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec51f740ffc8ad737758306011ae52ec: 2023-07-16 22:12:16,370 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,370 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:16,370 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/675672d3939e484c86b243fda5838eed.f0030ac784fcf392f31330654d0ff1ea->hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf/675672d3939e484c86b243fda5838eed-top, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/adcec918128c4441a42745d79d8b60b3.442aa1bd5dd75de03dc66678fdb7f77f->hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf/adcec918128c4441a42745d79d8b60b3-top] hfiles 2023-07-16 22:12:16,370 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/675672d3939e484c86b243fda5838eed.f0030ac784fcf392f31330654d0ff1ea for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,371 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/adcec918128c4441a42745d79d8b60b3.442aa1bd5dd75de03dc66678fdb7f77f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,395 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. completed. 2023-07-16 22:12:16,395 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:16,395 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:16,395 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:16,395 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,395 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 22:12:16,395 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:12:16,401 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 22:12:16,401 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,401 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:16,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,401 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 22:12:16,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:16,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:16,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:16,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37353,1689545452057': 2023-07-16 22:12:16,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-16 22:12:16,408 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-16 22:12:16,408 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:16,408 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:16,408 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,408 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:16,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:16,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:16,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:16,410 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:16,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:16,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:16,411 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:16,413 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,413 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,416 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:16,416 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,417 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,421 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:16,421 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:16,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:16,421 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:16,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:16,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:16,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:16,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:16,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:16,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,422 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:16,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:16,422 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:16,422 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,423 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:16,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,541 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:16,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 22:12:16,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:16,543 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:16,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-16 22:12:16,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,550 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689545536237Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689545536422 (+185 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689545536422Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689545536446 (+24 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689545536503 (+57 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689545536550 (+47 ms) 2023-07-16 22:12:16,553 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 22:12:16,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 301 msec 2023-07-16 22:12:16,843 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:16,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 22:12:16,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:16,847 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847 2023-07-16 22:12:16,847 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38033, tgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847, rawTgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847, srcFsUri=hdfs://localhost:38033, srcDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:12:16,872 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:12:16,873 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_280757394_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:16,873 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6, snapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-16 22:12:16,882 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:17,092 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0004_000001 (auth:SIMPLE) 2023-07-16 22:12:17,317 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,317 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,318 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,318 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,319 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,319 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,320 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,419 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop-5530245613314129313.jar 2023-07-16 22:12:17,420 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,421 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,421 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,422 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,422 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,423 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:17,424 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:12:17,424 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:12:17,425 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:12:17,425 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:12:17,426 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:12:17,427 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:12:17,427 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:12:17,428 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:12:17,429 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:12:17,430 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:12:17,431 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:17,431 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:17,432 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:17,432 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:17,433 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:17,433 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:17,434 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:17,958 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:12:19,387 WARN [Listener at jenkins-hbase4.apache.org/36941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:12:19,392 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-16 22:12:19,395 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-16 22:12:19,962 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:19,962 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:20,098 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0005_000001 (auth:SIMPLE) 2023-07-16 22:12:26,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0005_000001 (auth:SIMPLE) 2023-07-16 22:12:28,980 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0005_000001 (auth:SIMPLE) 2023-07-16 22:12:34,151 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:12:34,162 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:12:34,175 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,175 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:12:34,176 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:12:34,176 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,177 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 22:12:34,177 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 22:12:34,177 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,178 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 22:12:34,178 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545536847/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 22:12:34,187 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 22:12:34,193 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545554193"}]},"ts":"1689545554193"} 2023-07-16 22:12:34,194 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-16 22:12:34,196 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-16 22:12:34,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec51f740ffc8ad737758306011ae52ec, UNASSIGN}] 2023-07-16 22:12:34,199 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec51f740ffc8ad737758306011ae52ec, UNASSIGN 2023-07-16 22:12:34,200 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ec51f740ffc8ad737758306011ae52ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:34,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689545554200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545554200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545554200"}]},"ts":"1689545554200"} 2023-07-16 22:12:34,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ec51f740ffc8ad737758306011ae52ec, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:12:34,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 22:12:34,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:34,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec51f740ffc8ad737758306011ae52ec, disabling compactions & flushes 2023-07-16 22:12:34,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:34,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:34,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. after waiting 0 ms 2023-07-16 22:12:34,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:34,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-16 22:12:34,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:34,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec. 2023-07-16 22:12:34,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec51f740ffc8ad737758306011ae52ec: 2023-07-16 22:12:34,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:34,375 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ec51f740ffc8ad737758306011ae52ec, regionState=CLOSED 2023-07-16 22:12:34,375 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689545554375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545554375"}]},"ts":"1689545554375"} 2023-07-16 22:12:34,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-16 22:12:34,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ec51f740ffc8ad737758306011ae52ec, server=jenkins-hbase4.apache.org,37353,1689545452057 in 176 msec 2023-07-16 22:12:34,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-16 22:12:34,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec51f740ffc8ad737758306011ae52ec, UNASSIGN in 182 msec 2023-07-16 22:12:34,381 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545554381"}]},"ts":"1689545554381"} 2023-07-16 22:12:34,382 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-16 22:12:34,384 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-16 22:12:34,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 197 msec 2023-07-16 22:12:34,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 22:12:34,496 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-16 22:12:34,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,502 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,503 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,504 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,510 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:34,510 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:34,510 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:34,511 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,511 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,511 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,511 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 22:12:34,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 22:12:34,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 22:12:34,512 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,513 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,513 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,513 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,513 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,513 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,513 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 22:12:34,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:34,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:34,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:34,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 22:12:34,515 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 22:12:34,516 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:34,517 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/recovered.edits] 2023-07-16 22:12:34,517 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/recovered.edits] 2023-07-16 22:12:34,520 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/recovered.edits] 2023-07-16 22:12:34,532 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf/adcec918128c4441a42745d79d8b60b3 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/cf/adcec918128c4441a42745d79d8b60b3 2023-07-16 22:12:34,545 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/675672d3939e484c86b243fda5838eed.f0030ac784fcf392f31330654d0ff1ea to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/675672d3939e484c86b243fda5838eed.f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:34,545 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/recovered.edits/8.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f/recovered.edits/8.seqid 2023-07-16 22:12:34,547 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:34,548 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf/675672d3939e484c86b243fda5838eed to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/cf/675672d3939e484c86b243fda5838eed 2023-07-16 22:12:34,557 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/recovered.edits/8.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea/recovered.edits/8.seqid 2023-07-16 22:12:34,558 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0030ac784fcf392f31330654d0ff1ea 2023-07-16 22:12:34,559 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/adcec918128c4441a42745d79d8b60b3.442aa1bd5dd75de03dc66678fdb7f77f to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/cf/adcec918128c4441a42745d79d8b60b3.442aa1bd5dd75de03dc66678fdb7f77f 2023-07-16 22:12:34,566 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/recovered.edits/12.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec/recovered.edits/12.seqid 2023-07-16 22:12:34,566 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec51f740ffc8ad737758306011ae52ec 2023-07-16 22:12:34,567 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 22:12:34,570 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,575 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-16 22:12:34,589 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-16 22:12:34,591 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,591 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-16 22:12:34,591 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545554591"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:34,593 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-16 22:12:34,593 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ec51f740ffc8ad737758306011ae52ec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689545534376.ec51f740ffc8ad737758306011ae52ec.', STARTKEY => '', ENDKEY => ''}] 2023-07-16 22:12:34,593 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-16 22:12:34,593 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545554593"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:34,596 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-16 22:12:34,600 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:34,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 103 msec 2023-07-16 22:12:34,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 22:12:34,616 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-16 22:12:34,617 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 22:12:34,623 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545554622"}]},"ts":"1689545554622"} 2023-07-16 22:12:34,624 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-16 22:12:34,626 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-16 22:12:34,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=03d9e97760bc5c418a444f4cb1ce13bf, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=64ae9a4807159b91853b62198786b8b7, UNASSIGN}] 2023-07-16 22:12:34,637 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=03d9e97760bc5c418a444f4cb1ce13bf, UNASSIGN 2023-07-16 22:12:34,637 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=64ae9a4807159b91853b62198786b8b7, UNASSIGN 2023-07-16 22:12:34,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=03d9e97760bc5c418a444f4cb1ce13bf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:34,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545554638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545554638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545554638"}]},"ts":"1689545554638"} 2023-07-16 22:12:34,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=64ae9a4807159b91853b62198786b8b7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:34,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545554638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545554638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545554638"}]},"ts":"1689545554638"} 2023-07-16 22:12:34,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 03d9e97760bc5c418a444f4cb1ce13bf, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:12:34,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 64ae9a4807159b91853b62198786b8b7, server=jenkins-hbase4.apache.org,41119,1689545452128}] 2023-07-16 22:12:34,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 22:12:34,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:34,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 03d9e97760bc5c418a444f4cb1ce13bf, disabling compactions & flushes 2023-07-16 22:12:34,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:34,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:34,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. after waiting 0 ms 2023-07-16 22:12:34,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:34,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:34,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 64ae9a4807159b91853b62198786b8b7, disabling compactions & flushes 2023-07-16 22:12:34,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:34,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:34,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. after waiting 0 ms 2023-07-16 22:12:34,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:34,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:34,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf. 2023-07-16 22:12:34,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7. 2023-07-16 22:12:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 03d9e97760bc5c418a444f4cb1ce13bf: 2023-07-16 22:12:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 64ae9a4807159b91853b62198786b8b7: 2023-07-16 22:12:34,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:34,854 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=64ae9a4807159b91853b62198786b8b7, regionState=CLOSED 2023-07-16 22:12:34,855 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545554854"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545554854"}]},"ts":"1689545554854"} 2023-07-16 22:12:34,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:34,857 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=03d9e97760bc5c418a444f4cb1ce13bf, regionState=CLOSED 2023-07-16 22:12:34,857 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689545554857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545554857"}]},"ts":"1689545554857"} 2023-07-16 22:12:34,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-16 22:12:34,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 64ae9a4807159b91853b62198786b8b7, server=jenkins-hbase4.apache.org,41119,1689545452128 in 202 msec 2023-07-16 22:12:34,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-16 22:12:34,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=64ae9a4807159b91853b62198786b8b7, UNASSIGN in 235 msec 2023-07-16 22:12:34,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 03d9e97760bc5c418a444f4cb1ce13bf, server=jenkins-hbase4.apache.org,38577,1689545452169 in 212 msec 2023-07-16 22:12:34,866 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-16 22:12:34,866 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=03d9e97760bc5c418a444f4cb1ce13bf, UNASSIGN in 237 msec 2023-07-16 22:12:34,866 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545554866"}]},"ts":"1689545554866"} 2023-07-16 22:12:34,868 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-16 22:12:34,870 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-16 22:12:34,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 254 msec 2023-07-16 22:12:34,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 22:12:34,926 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-16 22:12:34,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,931 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,931 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,934 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,936 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,937 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,937 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,937 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 22:12:34,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 22:12:34,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 22:12:34,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 22:12:34,939 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,939 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,939 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,939 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,939 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,939 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,939 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,940 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:34,942 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:34,942 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:34,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 22:12:34,945 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/recovered.edits] 2023-07-16 22:12:34,945 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/recovered.edits] 2023-07-16 22:12:34,951 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf/fa2b66333a784cd9a48ad4bb1bc63af1 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/cf/fa2b66333a784cd9a48ad4bb1bc63af1 2023-07-16 22:12:34,952 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf/a521201d249a49ec8bce6056c7edf20f to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/cf/a521201d249a49ec8bce6056c7edf20f 2023-07-16 22:12:34,958 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7/recovered.edits/9.seqid 2023-07-16 22:12:34,958 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf/recovered.edits/9.seqid 2023-07-16 22:12:34,959 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/64ae9a4807159b91853b62198786b8b7 2023-07-16 22:12:34,959 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/03d9e97760bc5c418a444f4cb1ce13bf 2023-07-16 22:12:34,959 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 22:12:34,960 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-16 22:12:34,961 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-16 22:12:34,970 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307169197a332ceb3463898a837aee4ecdb76 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307169197a332ceb3463898a837aee4ecdb76 2023-07-16 22:12:34,971 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d952f5e98111426095fcab87b4fd61bd to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d952f5e98111426095fcab87b4fd61bd 2023-07-16 22:12:34,972 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-16 22:12:34,975 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,984 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-16 22:12:34,988 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-16 22:12:34,990 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,990 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-16 22:12:34,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545554990"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:34,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545554990"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:34,992 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:12:34,992 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 03d9e97760bc5c418a444f4cb1ce13bf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689545532660.03d9e97760bc5c418a444f4cb1ce13bf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 64ae9a4807159b91853b62198786b8b7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689545532660.64ae9a4807159b91853b62198786b8b7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:12:34,992 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-16 22:12:34,992 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545554992"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:34,994 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-16 22:12:34,996 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:34,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 69 msec 2023-07-16 22:12:35,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 22:12:35,044 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-16 22:12:35,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 22:12:35,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:35,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 22:12:35,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 22:12:35,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-16 22:12:35,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 22:12:35,103 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 745) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:52632 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1146495659_1 at /127.0.0.1:50912 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4222 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:34458 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_280757394_17 at /127.0.0.1:50932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:42779 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=592 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2097 (was 2203) 2023-07-16 22:12:35,103 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-16 22:12:35,138 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=592, ProcessCount=183, AvailableMemoryMB=2095 2023-07-16 22:12:35,139 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-16 22:12:35,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 22:12:35,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:35,149 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:12:35,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-16 22:12:35,150 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:12:35,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 22:12:35,156 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,156 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,156 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964 empty. 2023-07-16 22:12:35,157 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6 empty. 2023-07-16 22:12:35,157 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,157 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,157 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 22:12:35,180 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 22:12:35,187 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4074794289fcf4bcdde39c9541ec2964, NAME => 'testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:12:35,188 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 44410415fe7011b8a8ed3a36743cddc6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 44410415fe7011b8a8ed3a36743cddc6, disabling compactions & flushes 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4074794289fcf4bcdde39c9541ec2964, disabling compactions & flushes 2023-07-16 22:12:35,216 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,216 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. after waiting 0 ms 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. after waiting 0 ms 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,216 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,216 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,217 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 44410415fe7011b8a8ed3a36743cddc6: 2023-07-16 22:12:35,217 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4074794289fcf4bcdde39c9541ec2964: 2023-07-16 22:12:35,219 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:12:35,220 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545555220"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545555220"}]},"ts":"1689545555220"} 2023-07-16 22:12:35,220 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545555220"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545555220"}]},"ts":"1689545555220"} 2023-07-16 22:12:35,222 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:12:35,224 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:12:35,224 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545555224"}]},"ts":"1689545555224"} 2023-07-16 22:12:35,226 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 22:12:35,230 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:12:35,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:12:35,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:12:35,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:12:35,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:12:35,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4074794289fcf4bcdde39c9541ec2964, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=44410415fe7011b8a8ed3a36743cddc6, ASSIGN}] 2023-07-16 22:12:35,235 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=44410415fe7011b8a8ed3a36743cddc6, ASSIGN 2023-07-16 22:12:35,235 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4074794289fcf4bcdde39c9541ec2964, ASSIGN 2023-07-16 22:12:35,236 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=44410415fe7011b8a8ed3a36743cddc6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37353,1689545452057; forceNewPlan=false, retain=false 2023-07-16 22:12:35,236 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4074794289fcf4bcdde39c9541ec2964, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38577,1689545452169; forceNewPlan=false, retain=false 2023-07-16 22:12:35,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 22:12:35,386 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:12:35,389 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=44410415fe7011b8a8ed3a36743cddc6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,389 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4074794289fcf4bcdde39c9541ec2964, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,389 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545555389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545555389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545555389"}]},"ts":"1689545555389"} 2023-07-16 22:12:35,389 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545555389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545555389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545555389"}]},"ts":"1689545555389"} 2023-07-16 22:12:35,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 4074794289fcf4bcdde39c9541ec2964, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:12:35,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 44410415fe7011b8a8ed3a36743cddc6, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:12:35,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 22:12:35,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44410415fe7011b8a8ed3a36743cddc6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:12:35,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4074794289fcf4bcdde39c9541ec2964, NAME => 'testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. service=AccessControlService 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. service=AccessControlService 2023-07-16 22:12:35,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:35,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,550 INFO [StoreOpener-4074794289fcf4bcdde39c9541ec2964-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,550 INFO [StoreOpener-44410415fe7011b8a8ed3a36743cddc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,552 DEBUG [StoreOpener-4074794289fcf4bcdde39c9541ec2964-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf 2023-07-16 22:12:35,552 DEBUG [StoreOpener-4074794289fcf4bcdde39c9541ec2964-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf 2023-07-16 22:12:35,552 INFO [StoreOpener-4074794289fcf4bcdde39c9541ec2964-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4074794289fcf4bcdde39c9541ec2964 columnFamilyName cf 2023-07-16 22:12:35,553 DEBUG [StoreOpener-44410415fe7011b8a8ed3a36743cddc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf 2023-07-16 22:12:35,553 DEBUG [StoreOpener-44410415fe7011b8a8ed3a36743cddc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf 2023-07-16 22:12:35,554 INFO [StoreOpener-4074794289fcf4bcdde39c9541ec2964-1] regionserver.HStore(310): Store=4074794289fcf4bcdde39c9541ec2964/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:35,554 INFO [StoreOpener-44410415fe7011b8a8ed3a36743cddc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44410415fe7011b8a8ed3a36743cddc6 columnFamilyName cf 2023-07-16 22:12:35,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,555 INFO [StoreOpener-44410415fe7011b8a8ed3a36743cddc6-1] regionserver.HStore(310): Store=44410415fe7011b8a8ed3a36743cddc6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:35,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:35,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:35,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:35,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4074794289fcf4bcdde39c9541ec2964; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70906060, jitterRate=0.056582629680633545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:35,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4074794289fcf4bcdde39c9541ec2964: 2023-07-16 22:12:35,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:35,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964., pid=93, masterSystemTime=1689545555543 2023-07-16 22:12:35,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44410415fe7011b8a8ed3a36743cddc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61124914, jitterRate=-0.08916780352592468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:35,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44410415fe7011b8a8ed3a36743cddc6: 2023-07-16 22:12:35,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6., pid=94, masterSystemTime=1689545555543 2023-07-16 22:12:35,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,566 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4074794289fcf4bcdde39c9541ec2964, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,566 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545555566"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545555566"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545555566"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545555566"}]},"ts":"1689545555566"} 2023-07-16 22:12:35,567 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=44410415fe7011b8a8ed3a36743cddc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,567 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545555567"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545555567"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545555567"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545555567"}]},"ts":"1689545555567"} 2023-07-16 22:12:35,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-16 22:12:35,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 4074794289fcf4bcdde39c9541ec2964, server=jenkins-hbase4.apache.org,38577,1689545452169 in 177 msec 2023-07-16 22:12:35,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-16 22:12:35,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 44410415fe7011b8a8ed3a36743cddc6, server=jenkins-hbase4.apache.org,37353,1689545452057 in 177 msec 2023-07-16 22:12:35,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4074794289fcf4bcdde39c9541ec2964, ASSIGN in 339 msec 2023-07-16 22:12:35,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-16 22:12:35,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=44410415fe7011b8a8ed3a36743cddc6, ASSIGN in 340 msec 2023-07-16 22:12:35,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:12:35,575 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545555575"}]},"ts":"1689545555575"} 2023-07-16 22:12:35,576 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 22:12:35,579 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:12:35,579 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-16 22:12:35,581 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:12:35,582 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:35,582 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:35,582 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:35,582 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:35,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 443 msec 2023-07-16 22:12:35,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:35,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:35,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:35,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:35,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 22:12:35,755 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-16 22:12:35,757 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:35,757 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,759 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:35,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:35,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545555772 (current time:1689545555772). 2023-07-16 22:12:35,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:35,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x1f847910 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:35,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@95e41a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:35,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:35,790 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:35,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f847910 to 127.0.0.1:58223 2023-07-16 22:12:35,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:35,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x1a963028 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:35,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26668693, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:35,811 DEBUG [hconnection-0x5dce88b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:35,814 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:35,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:35,825 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:35,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a963028 to 127.0.0.1:58223 2023-07-16 22:12:35,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:35,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:12:35,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:35,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:35,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:35,832 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:35,834 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689546155834 2023-07-16 22:12:35,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:35,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:35,836 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:35,836 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:35,845 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:35,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:35,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-16 22:12:35,852 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:35,853 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689546155853 2023-07-16 22:12:35,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,865 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-16 22:12:35,865 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:35,866 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 22:12:35,866 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 22:12:35,867 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,867 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,873 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,873 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,873 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,873 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:35,874 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,874 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:35,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:35,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 22:12:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:35,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 22:12:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 22:12:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,877 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:35,877 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:35,877 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:35,877 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:35,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,877 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:35,885 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,886 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:35,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,884 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:35,887 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:35,889 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:35,889 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:35,892 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,893 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,893 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,893 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,893 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,894 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:35,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:35,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,897 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:35,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:35,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 22:12:35,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad4af2[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:35,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:35,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 22:12:35,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad4af2[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:35,904 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 22:12:35,904 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:35,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,906 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:35,906 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,907 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. started... 2023-07-16 22:12:35,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,906 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:35,907 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:35,907 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,907 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:35,907 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:35,907 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:35,907 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:12:35,909 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:35,909 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,909 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:35,921 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:35,921 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:35,921 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:35,921 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44410415fe7011b8a8ed3a36743cddc6: 2023-07-16 22:12:35,921 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. started... 2023-07-16 22:12:35,922 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,922 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:35,922 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:35,922 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4074794289fcf4bcdde39c9541ec2964: 2023-07-16 22:12:35,922 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,922 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:35,922 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:35,947 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:35,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:35,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:35,949 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:35,962 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. completed. 2023-07-16 22:12:35,962 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:35,962 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:35,962 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:35,962 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,962 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:35,963 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:12:35,965 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,965 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:35,965 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,965 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:35,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:35,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:35,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:35,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:35,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:35,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:35,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37353,1689545452057': 2023-07-16 22:12:35,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 22:12:36,149 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:36,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:36,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:36,151 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:36,362 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. completed. 2023-07-16 22:12:36,362 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:36,362 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:36,362 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:36,362 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,362 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:36,362 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:12:36,364 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,364 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,364 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:36,364 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:36,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:12:36,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 22:12:36,371 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 22:12:36,371 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:36,371 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:36,371 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,371 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:36,374 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,374 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,374 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:36,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:36,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,374 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:36,374 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:36,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:36,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:36,375 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,376 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:36,376 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,376 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,377 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:36,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:36,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:36,378 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:36,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,379 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:36,380 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:36,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:36,384 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:36,384 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:36,384 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:36,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:36,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:36,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:36,384 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:36,385 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:36,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:36,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:36,384 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:36,385 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,385 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:36,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:36,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:36,389 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:36,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:36,389 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:36,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:12:36,393 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,393 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,393 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:36,393 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,393 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:36,393 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:36,394 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:36,394 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 22:12:36,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:36,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:36,401 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-16 22:12:36,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,451 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:36,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:36,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:36,452 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 22:12:36,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 22:12:36,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,556 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:36,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689545555834Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689545556433 (+599 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689545556433Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689545556434 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689545556455 (+21 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689545556489 (+34 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689545556555 (+66 ms) 2023-07-16 22:12:36,560 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:36,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 724 msec 2023-07-16 22:12:36,953 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:36,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:36,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:36,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38577] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:36,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37353] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:36,962 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:36,962 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:36,962 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:36,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:36,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545556974 (current time:1689545556974). 2023-07-16 22:12:36,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:36,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x6dac6486 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:36,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@440ed2b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:36,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:36,993 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:36,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dac6486 to 127.0.0.1:58223 2023-07-16 22:12:36,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:36,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x0c9467d1 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:37,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@212ba91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:37,003 DEBUG [hconnection-0x30bb5315-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:37,004 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:37,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:37,009 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:37,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c9467d1 to 127.0.0.1:58223 2023-07-16 22:12:37,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:37,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 22:12:37,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:37,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:37,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:37,015 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:37,016 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689546157016 2023-07-16 22:12:37,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 22:12:37,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:37,017 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:37,017 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:37,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:37,019 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 22:12:37,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-16 22:12:37,021 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:37,021 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689546157021 2023-07-16 22:12:37,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,030 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-16 22:12:37,030 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:37,031 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 22:12:37,031 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 22:12:37,032 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,032 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,033 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:37,033 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:37,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:37,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:37,033 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,033 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:37,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:37,033 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,033 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,034 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,034 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 22:12:37,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:37,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 22:12:37,035 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:37,035 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:37,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:37,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:37,036 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 22:12:37,037 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:37,037 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:37,041 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 22:12:37,041 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 22:12:37,041 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 22:12:37,042 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,042 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:37,044 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,044 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:37,045 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,045 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:37,045 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,045 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,045 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:37,045 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,045 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:37,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 22:12:37,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7400b36a[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:37,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 22:12:37,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7400b36a[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:37,050 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 22:12:37,050 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,059 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,059 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,060 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,060 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:37,060 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:37,060 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 22:12:37,060 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:37,060 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:12:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:37,062 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:37,062 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:37,062 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:37,062 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:37,062 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:37,062 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. started... 2023-07-16 22:12:37,062 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. started... 2023-07-16 22:12:37,062 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4074794289fcf4bcdde39c9541ec2964 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 22:12:37,062 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 44410415fe7011b8a8ed3a36743cddc6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 22:12:37,063 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:37,063 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:37,063 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:37,065 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,065 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,066 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:37,087 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716b667452fa740411f8e3af96bce16e214 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716b667452fa740411f8e3af96bce16e214 2023-07-16 22:12:37,094 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071611062110930941169a93cf3e8d4e5702 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071611062110930941169a93cf3e8d4e5702 2023-07-16 22:12:37,100 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/.tmp/cf/03b42b121eef4de5b4882be372da9a71 2023-07-16 22:12:37,104 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/.tmp/cf/ccc1da21c1554e048a7703a9ff03775e 2023-07-16 22:12:37,106 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/.tmp/cf/03b42b121eef4de5b4882be372da9a71 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf/03b42b121eef4de5b4882be372da9a71 2023-07-16 22:12:37,111 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/.tmp/cf/ccc1da21c1554e048a7703a9ff03775e as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf/ccc1da21c1554e048a7703a9ff03775e 2023-07-16 22:12:37,111 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf/03b42b121eef4de5b4882be372da9a71, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 22:12:37,112 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 4074794289fcf4bcdde39c9541ec2964 in 50ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:37,114 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4074794289fcf4bcdde39c9541ec2964: 2023-07-16 22:12:37,114 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,114 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:37,114 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf/03b42b121eef4de5b4882be372da9a71] hfiles 2023-07-16 22:12:37,114 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf/03b42b121eef4de5b4882be372da9a71 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,117 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf/ccc1da21c1554e048a7703a9ff03775e, entries=47, sequenceid=6, filesize=13.1 K 2023-07-16 22:12:37,118 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:37,118 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 44410415fe7011b8a8ed3a36743cddc6 in 56ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:37,119 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44410415fe7011b8a8ed3a36743cddc6: 2023-07-16 22:12:37,119 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,119 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:37,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:37,119 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf/ccc1da21c1554e048a7703a9ff03775e] hfiles 2023-07-16 22:12:37,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:37,119 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf/ccc1da21c1554e048a7703a9ff03775e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,119 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:37,122 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. completed. 2023-07-16 22:12:37,122 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:37,123 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:37,123 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:37,123 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,123 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:37,123 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:12:37,124 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,124 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:37,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:37,124 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:37,125 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:37,128 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. completed. 2023-07-16 22:12:37,129 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:37,129 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:37,129 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:37,129 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,129 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 22:12:37,129 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:12:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,130 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,131 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 22:12:37,131 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:37,131 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 22:12:37,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:12:37,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 22:12:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:37,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:37,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37353,1689545452057': 2023-07-16 22:12:37,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 22:12:37,155 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 22:12:37,155 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:37,155 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:37,155 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,155 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:37,158 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:37,158 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:37,158 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:37,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:37,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,159 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:37,159 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,160 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:37,162 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,162 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,162 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:37,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:37,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:37,166 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:37,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:37,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:37,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:37,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:37,166 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:37,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:37,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:37,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:37,168 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:37,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:37,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:12:37,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:37,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:37,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:37,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,169 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071611062110930941169a93cf3e8d4e5702, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716b667452fa740411f8e3af96bce16e214] mob files 2023-07-16 22:12:37,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071611062110930941169a93cf3e8d4e5702 2023-07-16 22:12:37,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716b667452fa740411f8e3af96bce16e214 2023-07-16 22:12:37,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 22:12:37,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,235 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689545557016Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689545557180 (+164 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689545557180Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689545557180Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689545557188 (+8 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689545557200 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689545557234 (+34 ms) 2023-07-16 22:12:37,240 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 22:12:37,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 223 msec 2023-07-16 22:12:37,319 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:37,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 22:12:37,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:37,321 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321 2023-07-16 22:12:37,321 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38033, tgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321, rawTgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321, srcFsUri=hdfs://localhost:38033, srcDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:12:37,354 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:12:37,354 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2079439565_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,354 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6, snapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-16 22:12:37,365 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:37,857 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,858 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,858 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,859 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,859 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,860 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,860 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,959 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop-4143346897380774312.jar 2023-07-16 22:12:37,959 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,960 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,960 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,961 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,961 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,962 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:37,962 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:12:37,963 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:12:37,964 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:12:37,964 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:12:37,965 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:12:37,965 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:12:37,966 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:12:37,978 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:12:37,979 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:12:37,980 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:12:37,981 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:37,981 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:37,982 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:37,982 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:37,982 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:37,983 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:37,983 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:39,071 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0005_000001 (auth:SIMPLE) 2023-07-16 22:12:39,621 WARN [Listener at jenkins-hbase4.apache.org/36941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:12:39,625 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-16 22:12:39,798 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:39,798 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:40,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0006_000001 (auth:SIMPLE) 2023-07-16 22:12:40,037 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:12:46,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0006_000001 (auth:SIMPLE) 2023-07-16 22:12:49,115 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:12:49,117 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:12:49,168 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:49,169 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:12:49,170 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:12:49,170 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:49,171 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 22:12:49,171 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 22:12:49,172 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:49,172 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 22:12:49,172 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545557321/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 22:12:49,194 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545569200"}]},"ts":"1689545569200"} 2023-07-16 22:12:49,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 22:12:49,202 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 22:12:49,204 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-16 22:12:49,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4074794289fcf4bcdde39c9541ec2964, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=44410415fe7011b8a8ed3a36743cddc6, UNASSIGN}] 2023-07-16 22:12:49,207 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4074794289fcf4bcdde39c9541ec2964, UNASSIGN 2023-07-16 22:12:49,207 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=44410415fe7011b8a8ed3a36743cddc6, UNASSIGN 2023-07-16 22:12:49,208 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=44410415fe7011b8a8ed3a36743cddc6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:49,208 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4074794289fcf4bcdde39c9541ec2964, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:49,208 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545569208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545569208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545569208"}]},"ts":"1689545569208"} 2023-07-16 22:12:49,208 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545569208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545569208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545569208"}]},"ts":"1689545569208"} 2023-07-16 22:12:49,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 44410415fe7011b8a8ed3a36743cddc6, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:12:49,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 4074794289fcf4bcdde39c9541ec2964, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:12:49,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 22:12:49,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:49,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44410415fe7011b8a8ed3a36743cddc6, disabling compactions & flushes 2023-07-16 22:12:49,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:49,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:49,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. after waiting 0 ms 2023-07-16 22:12:49,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:49,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:49,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4074794289fcf4bcdde39c9541ec2964, disabling compactions & flushes 2023-07-16 22:12:49,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:49,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:49,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. after waiting 0 ms 2023-07-16 22:12:49,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:49,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:49,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:49,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:12:49,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6. 2023-07-16 22:12:49,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44410415fe7011b8a8ed3a36743cddc6: 2023-07-16 22:12:49,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:12:49,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964. 2023-07-16 22:12:49,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4074794289fcf4bcdde39c9541ec2964: 2023-07-16 22:12:49,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:49,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=44410415fe7011b8a8ed3a36743cddc6, regionState=CLOSED 2023-07-16 22:12:49,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:49,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545569385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545569385"}]},"ts":"1689545569385"} 2023-07-16 22:12:49,389 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4074794289fcf4bcdde39c9541ec2964, regionState=CLOSED 2023-07-16 22:12:49,389 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689545569389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545569389"}]},"ts":"1689545569389"} 2023-07-16 22:12:49,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-16 22:12:49,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 44410415fe7011b8a8ed3a36743cddc6, server=jenkins-hbase4.apache.org,37353,1689545452057 in 180 msec 2023-07-16 22:12:49,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-16 22:12:49,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 4074794289fcf4bcdde39c9541ec2964, server=jenkins-hbase4.apache.org,38577,1689545452169 in 181 msec 2023-07-16 22:12:49,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=44410415fe7011b8a8ed3a36743cddc6, UNASSIGN in 187 msec 2023-07-16 22:12:49,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-16 22:12:49,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4074794289fcf4bcdde39c9541ec2964, UNASSIGN in 188 msec 2023-07-16 22:12:49,399 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545569399"}]},"ts":"1689545569399"} 2023-07-16 22:12:49,400 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 22:12:49,402 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-16 22:12:49,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 208 msec 2023-07-16 22:12:49,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 22:12:49,503 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-16 22:12:49,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,507 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,509 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,513 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:49,513 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:49,513 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,514 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,514 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,514 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 22:12:49,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 22:12:49,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 22:12:49,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 22:12:49,515 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/recovered.edits] 2023-07-16 22:12:49,515 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/recovered.edits] 2023-07-16 22:12:49,515 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,515 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,515 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:49,515 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,515 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:49,515 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,516 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:49,515 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:49,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 22:12:49,520 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf/03b42b121eef4de5b4882be372da9a71 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/cf/03b42b121eef4de5b4882be372da9a71 2023-07-16 22:12:49,521 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf/ccc1da21c1554e048a7703a9ff03775e to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/cf/ccc1da21c1554e048a7703a9ff03775e 2023-07-16 22:12:49,523 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964/recovered.edits/9.seqid 2023-07-16 22:12:49,524 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6/recovered.edits/9.seqid 2023-07-16 22:12:49,524 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/4074794289fcf4bcdde39c9541ec2964 2023-07-16 22:12:49,524 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testEmptyExportFileSystemState/44410415fe7011b8a8ed3a36743cddc6 2023-07-16 22:12:49,524 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 22:12:49,525 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-16 22:12:49,525 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-16 22:12:49,529 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071611062110930941169a93cf3e8d4e5702 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071611062110930941169a93cf3e8d4e5702 2023-07-16 22:12:49,530 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716b667452fa740411f8e3af96bce16e214 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716b667452fa740411f8e3af96bce16e214 2023-07-16 22:12:49,531 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-16 22:12:49,533 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,535 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-16 22:12:49,536 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-16 22:12:49,540 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,540 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-16 22:12:49,540 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545569540"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:49,540 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545569540"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:49,542 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:12:49,542 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4074794289fcf4bcdde39c9541ec2964, NAME => 'testtb-testEmptyExportFileSystemState,,1689545555140.4074794289fcf4bcdde39c9541ec2964.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 44410415fe7011b8a8ed3a36743cddc6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689545555140.44410415fe7011b8a8ed3a36743cddc6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:12:49,542 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-16 22:12:49,542 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545569542"}]},"ts":"9223372036854775807"} 2023-07-16 22:12:49,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-16 22:12:49,545 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 22:12:49,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 41 msec 2023-07-16 22:12:49,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 22:12:49,618 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-16 22:12:49,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-16 22:12:49,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:49,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-16 22:12:49,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-16 22:12:49,657 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 758) Potentially hanging thread: Thread-4905 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:34459 from appattempt_1689545459911_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:60464 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:44754 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:36941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:37969 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:40780 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_865603052_1 at /127.0.0.1:40756 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_865603052_1 at /127.0.0.1:60434 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=609 (was 592) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1379 (was 2095) 2023-07-16 22:12:49,657 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 22:12:49,681 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=609, ProcessCount=183, AvailableMemoryMB=1378 2023-07-16 22:12:49,681 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 22:12:49,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 22:12:49,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:49,691 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 22:12:49,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-16 22:12:49,691 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 22:12:49,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 22:12:49,694 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:49,694 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:49,695 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15 empty. 2023-07-16 22:12:49,695 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7 empty. 2023-07-16 22:12:49,695 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:49,695 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:49,695 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 22:12:49,708 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-16 22:12:49,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce09c7375be061513d84c5260808ec15, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:12:49,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 78f484b8475f4a8d14663cb60f68b6f7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp 2023-07-16 22:12:49,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:49,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ce09c7375be061513d84c5260808ec15, disabling compactions & flushes 2023-07-16 22:12:49,718 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:49,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:49,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. after waiting 0 ms 2023-07-16 22:12:49,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:49,718 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:49,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:49,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ce09c7375be061513d84c5260808ec15: 2023-07-16 22:12:49,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 78f484b8475f4a8d14663cb60f68b6f7, disabling compactions & flushes 2023-07-16 22:12:49,719 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:49,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:49,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. after waiting 0 ms 2023-07-16 22:12:49,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:49,719 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:49,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 78f484b8475f4a8d14663cb60f68b6f7: 2023-07-16 22:12:49,721 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 22:12:49,722 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545569722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545569722"}]},"ts":"1689545569722"} 2023-07-16 22:12:49,723 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545569722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545569722"}]},"ts":"1689545569722"} 2023-07-16 22:12:49,725 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 22:12:49,725 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 22:12:49,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545569725"}]},"ts":"1689545569725"} 2023-07-16 22:12:49,727 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-16 22:12:49,730 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 22:12:49,732 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 22:12:49,732 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 22:12:49,732 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 22:12:49,732 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 22:12:49,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce09c7375be061513d84c5260808ec15, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78f484b8475f4a8d14663cb60f68b6f7, ASSIGN}] 2023-07-16 22:12:49,735 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78f484b8475f4a8d14663cb60f68b6f7, ASSIGN 2023-07-16 22:12:49,735 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce09c7375be061513d84c5260808ec15, ASSIGN 2023-07-16 22:12:49,735 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78f484b8475f4a8d14663cb60f68b6f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38577,1689545452169; forceNewPlan=false, retain=false 2023-07-16 22:12:49,735 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce09c7375be061513d84c5260808ec15, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37353,1689545452057; forceNewPlan=false, retain=false 2023-07-16 22:12:49,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 22:12:49,886 INFO [jenkins-hbase4:35007] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 22:12:49,889 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=78f484b8475f4a8d14663cb60f68b6f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:49,890 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545569889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545569889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545569889"}]},"ts":"1689545569889"} 2023-07-16 22:12:49,889 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ce09c7375be061513d84c5260808ec15, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:49,890 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545569889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545569889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545569889"}]},"ts":"1689545569889"} 2023-07-16 22:12:49,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 78f484b8475f4a8d14663cb60f68b6f7, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:12:49,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure ce09c7375be061513d84c5260808ec15, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:12:49,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 22:12:50,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:50,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78f484b8475f4a8d14663cb60f68b6f7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 22:12:50,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:50,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce09c7375be061513d84c5260808ec15, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 22:12:50,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. service=AccessControlService 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. service=AccessControlService 2023-07-16 22:12:50,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:50,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:50,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:50,053 INFO [StoreOpener-ce09c7375be061513d84c5260808ec15-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:50,053 INFO [StoreOpener-78f484b8475f4a8d14663cb60f68b6f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:50,055 DEBUG [StoreOpener-78f484b8475f4a8d14663cb60f68b6f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf 2023-07-16 22:12:50,055 DEBUG [StoreOpener-ce09c7375be061513d84c5260808ec15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf 2023-07-16 22:12:50,055 DEBUG [StoreOpener-ce09c7375be061513d84c5260808ec15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf 2023-07-16 22:12:50,056 INFO [StoreOpener-ce09c7375be061513d84c5260808ec15-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce09c7375be061513d84c5260808ec15 columnFamilyName cf 2023-07-16 22:12:50,055 DEBUG [StoreOpener-78f484b8475f4a8d14663cb60f68b6f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf 2023-07-16 22:12:50,056 INFO [StoreOpener-78f484b8475f4a8d14663cb60f68b6f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78f484b8475f4a8d14663cb60f68b6f7 columnFamilyName cf 2023-07-16 22:12:50,057 INFO [StoreOpener-ce09c7375be061513d84c5260808ec15-1] regionserver.HStore(310): Store=ce09c7375be061513d84c5260808ec15/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:50,057 INFO [StoreOpener-78f484b8475f4a8d14663cb60f68b6f7-1] regionserver.HStore(310): Store=78f484b8475f4a8d14663cb60f68b6f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 22:12:50,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:50,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:50,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:50,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:50,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce09c7375be061513d84c5260808ec15 2023-07-16 22:12:50,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:12:50,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:50,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 22:12:50,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce09c7375be061513d84c5260808ec15; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67742410, jitterRate=0.009440571069717407}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:50,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 78f484b8475f4a8d14663cb60f68b6f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71142667, jitterRate=0.06010834872722626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 22:12:50,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce09c7375be061513d84c5260808ec15: 2023-07-16 22:12:50,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 78f484b8475f4a8d14663cb60f68b6f7: 2023-07-16 22:12:50,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15., pid=109, masterSystemTime=1689545570048 2023-07-16 22:12:50,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7., pid=108, masterSystemTime=1689545570047 2023-07-16 22:12:50,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:50,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:50,068 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ce09c7375be061513d84c5260808ec15, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,068 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545570068"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545570068"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545570068"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545570068"}]},"ts":"1689545570068"} 2023-07-16 22:12:50,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:50,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:50,075 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=78f484b8475f4a8d14663cb60f68b6f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,075 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545570075"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689545570075"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689545570075"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689545570075"}]},"ts":"1689545570075"} 2023-07-16 22:12:50,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-16 22:12:50,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure ce09c7375be061513d84c5260808ec15, server=jenkins-hbase4.apache.org,37353,1689545452057 in 179 msec 2023-07-16 22:12:50,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-16 22:12:50,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 78f484b8475f4a8d14663cb60f68b6f7, server=jenkins-hbase4.apache.org,38577,1689545452169 in 184 msec 2023-07-16 22:12:50,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce09c7375be061513d84c5260808ec15, ASSIGN in 346 msec 2023-07-16 22:12:50,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-16 22:12:50,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78f484b8475f4a8d14663cb60f68b6f7, ASSIGN in 347 msec 2023-07-16 22:12:50,082 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 22:12:50,082 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545570082"}]},"ts":"1689545570082"} 2023-07-16 22:12:50,083 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-16 22:12:50,085 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 22:12:50,086 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-16 22:12:50,087 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 22:12:50,089 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:50,089 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:50,089 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:50,089 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:12:50,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:50,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:50,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:50,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 22:12:50,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 408 msec 2023-07-16 22:12:50,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 22:12:50,297 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-16 22:12:50,299 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,299 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:50,302 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:50,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:50,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545570314 (current time:1689545570314). 2023-07-16 22:12:50,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:50,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x042e34fa to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:50,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33ecb1c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:50,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:50,325 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:50,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x042e34fa to 127.0.0.1:58223 2023-07-16 22:12:50,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:50,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x4454dd16 to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:50,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3128b882, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:50,432 DEBUG [hconnection-0x679c7dd6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:50,435 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:50,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:50,442 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:50,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4454dd16 to 127.0.0.1:58223 2023-07-16 22:12:50,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:50,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 22:12:50,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:50,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:50,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:50,447 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:50,448 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689546170448 2023-07-16 22:12:50,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:50,448 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,450 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:50,450 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:50,451 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:50,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:50,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-16 22:12:50,453 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:50,459 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689546170459 2023-07-16 22:12:50,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,503 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 22:12:50,503 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:50,505 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 22:12:50,505 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 22:12:50,506 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,506 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,507 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,507 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,508 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,508 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,509 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,509 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,510 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,510 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:50,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 22:12:50,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,511 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:50,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,511 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 22:12:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,511 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:50,513 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:50,513 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:50,513 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:50,517 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:50,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,518 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:50,518 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:50,520 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:50,520 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:50,520 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:50,524 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,524 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 22:12:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:50,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,526 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,526 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,526 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:50,526 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,526 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,527 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:50,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 22:12:50,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e2c976[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:50,529 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:50,529 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:50,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,530 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:50,531 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:50,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,531 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:50,532 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,533 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,533 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:50,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 22:12:50,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e2c976[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:50,537 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 22:12:50,537 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,539 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:50,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,539 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:50,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,539 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:50,540 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:50,540 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:50,540 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:12:50,540 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:50,540 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:50,540 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:50,540 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. started... 2023-07-16 22:12:50,540 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ce09c7375be061513d84c5260808ec15: 2023-07-16 22:12:50,540 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:50,541 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:50,541 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,541 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:50,541 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:50,541 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:50,541 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. started... 2023-07-16 22:12:50,542 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78f484b8475f4a8d14663cb60f68b6f7: 2023-07-16 22:12:50,543 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:50,543 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,543 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:50,543 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 22:12:50,543 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:50,543 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:50,553 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:50,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:50,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:50,556 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:50,592 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. completed. 2023-07-16 22:12:50,592 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:50,592 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:50,592 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:50,592 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,592 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:50,592 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:12:50,594 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:50,594 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,594 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:50,594 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:50,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:12:50,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 22:12:50,607 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. completed. 2023-07-16 22:12:50,607 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:12:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:50,609 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:50,610 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37353,1689545452057': 2023-07-16 22:12:50,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 22:12:50,618 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 22:12:50,618 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:50,618 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:50,618 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,618 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:50,621 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,621 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,621 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,621 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,621 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,621 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,627 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:50,627 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,628 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:50,628 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,634 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,635 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,635 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,639 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,639 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,639 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,639 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,639 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,639 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,639 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,639 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,647 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,647 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:50,647 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:50,647 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:50,647 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:50,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:50,647 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:50,647 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:50,647 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:50,647 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,648 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:50,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,652 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:12:50,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 22:12:50,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,756 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:50,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:50,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:50,758 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:50,770 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 22:12:50,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,771 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:50,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689545570448Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689545570688 (+240 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689545570688Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689545570688Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689545570693 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689545570729 (+36 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689545570770 (+41 ms) 2023-07-16 22:12:50,775 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:50,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 326 msec 2023-07-16 22:12:51,058 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:51,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:51,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:51,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37353] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:51,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 22:12:51,065 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,065 DEBUG [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:51,065 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 22:12:51,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:51,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689545571075 (current time:1689545571075). 2023-07-16 22:12:51,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 22:12:51,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x3914f79b to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:51,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de25fa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:51,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:51,085 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:51,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3914f79b to 127.0.0.1:58223 2023-07-16 22:12:51,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:51,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(139): Connect 0x298c6eec to 127.0.0.1:58223 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 22:12:51,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@373aec69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 22:12:51,202 DEBUG [hconnection-0x180aba63-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:51,206 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:51,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 22:12:51,214 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 22:12:51,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x298c6eec to 127.0.0.1:58223 2023-07-16 22:12:51,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:12:51,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 22:12:51,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 22:12:51,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:51,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:51,220 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:51,221 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689546171221 2023-07-16 22:12:51,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 22:12:51,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,223 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 22:12:51,224 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 22:12:51,225 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 22:12:51,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:51,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-16 22:12:51,228 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:51,229 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689546171229 2023-07-16 22:12:51,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,250 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 22:12:51,250 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:51,251 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 22:12:51,251 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 22:12:51,252 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,252 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,253 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:51,253 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:51,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:51,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:51,253 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,253 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:51,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:51,254 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,254 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,254 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,254 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 22:12:51,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,255 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,255 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:51,255 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:51,256 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 22:12:51,257 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:51,255 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 22:12:51,258 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:51,257 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:51,259 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:51,259 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:51,259 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 22:12:51,259 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 22:12:51,259 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41119,1689545452128' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:51,259 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:51,259 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 22:12:51,261 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,261 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,261 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:51,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:51,262 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,262 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:51,262 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:51,262 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:51,262 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,263 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:51,263 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,263 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 22:12:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:51,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37353,1689545452057' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 22:12:51,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc9d531[Count = 1] remaining members to acquire global barrier 2023-07-16 22:12:51,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:51,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:51,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:51,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:51,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:51,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38577,1689545452169' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 22:12:51,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc9d531[Count = 0] remaining members to acquire global barrier 2023-07-16 22:12:51,267 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 22:12:51,267 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:51,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,273 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:51,273 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 22:12:51,273 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:51,273 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,273 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:51,274 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:51,274 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:51,273 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41119,1689545452128' in zk 2023-07-16 22:12:51,274 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. started... 2023-07-16 22:12:51,273 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:51,274 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,274 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 22:12:51,273 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 22:12:51,274 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 22:12:51,274 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 78f484b8475f4a8d14663cb60f68b6f7 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 22:12:51,274 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. started... 2023-07-16 22:12:51,274 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ce09c7375be061513d84c5260808ec15 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 22:12:51,276 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:51,276 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:51,276 DEBUG [member: 'jenkins-hbase4.apache.org,41119,1689545452128' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:51,307 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716c00ca4e1b4f04436abbe9968a4d082e9 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716c00ca4e1b4f04436abbe9968a4d082e9 2023-07-16 22:12:51,311 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716f120cbd7fd9548399f8ff96075b9166e to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716f120cbd7fd9548399f8ff96075b9166e 2023-07-16 22:12:51,345 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:51,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:51,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:51,347 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 22:12:51,354 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/.tmp/cf/2041ffe2f28e4269ab53c9de48f5fd01 2023-07-16 22:12:51,362 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/.tmp/cf/2041ffe2f28e4269ab53c9de48f5fd01 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf/2041ffe2f28e4269ab53c9de48f5fd01 2023-07-16 22:12:51,373 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf/2041ffe2f28e4269ab53c9de48f5fd01, entries=2, sequenceid=6, filesize=5.2 K 2023-07-16 22:12:51,374 INFO [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ce09c7375be061513d84c5260808ec15 in 100ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:51,374 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 22:12:51,375 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ce09c7375be061513d84c5260808ec15: 2023-07-16 22:12:51,375 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,375 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:51,376 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf/2041ffe2f28e4269ab53c9de48f5fd01] hfiles 2023-07-16 22:12:51,376 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf/2041ffe2f28e4269ab53c9de48f5fd01 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,381 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/.tmp/cf/a200b43822334393b39fee9b8e29a974 2023-07-16 22:12:51,396 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/.tmp/cf/a200b43822334393b39fee9b8e29a974 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf/a200b43822334393b39fee9b8e29a974 2023-07-16 22:12:51,402 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf/a200b43822334393b39fee9b8e29a974, entries=48, sequenceid=6, filesize=13.5 K 2023-07-16 22:12:51,403 INFO [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 78f484b8475f4a8d14663cb60f68b6f7 in 129ms, sequenceid=6, compaction requested=false 2023-07-16 22:12:51,412 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78f484b8475f4a8d14663cb60f68b6f7: 2023-07-16 22:12:51,412 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,412 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 22:12:51,412 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf/a200b43822334393b39fee9b8e29a974] hfiles 2023-07-16 22:12:51,412 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf/a200b43822334393b39fee9b8e29a974 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,423 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. completed. 2023-07-16 22:12:51,423 DEBUG [rs(jenkins-hbase4.apache.org,37353,1689545452057)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:12:51,423 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:51,423 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:51,423 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,423 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:51,423 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37353,1689545452057' in zk 2023-07-16 22:12:51,425 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,425 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,426 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:51,426 DEBUG [member: 'jenkins-hbase4.apache.org,37353,1689545452057' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37353,1689545452057': 2023-07-16 22:12:51,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37353,1689545452057' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 22:12:51,435 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. completed. 2023-07-16 22:12:51,435 DEBUG [rs(jenkins-hbase4.apache.org,38577,1689545452169)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:12:51,436 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 22:12:51,436 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 22:12:51,436 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,436 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 22:12:51,436 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38577,1689545452169' in zk 2023-07-16 22:12:51,438 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 22:12:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,38577,1689545452169' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 22:12:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38577,1689545452169': 2023-07-16 22:12:51,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38577,1689545452169' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 22:12:51,444 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 22:12:51,444 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 22:12:51,444 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 22:12:51,444 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,444 INFO [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 22:12:51,446 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,446 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,446 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:51,446 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,446 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,446 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:51,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:51,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:51,448 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:51,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:51,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:51,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:51,449 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,449 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,451 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,451 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,452 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,453 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 22:12:51,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 22:12:51,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:51,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:51,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:51,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 22:12:51,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:51,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 22:12:51,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 22:12:51,456 DEBUG [(jenkins-hbase4.apache.org,35007,1689545450581)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:12:51,457 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:51,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 22:12:51,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 22:12:51,456 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 22:12:51,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 22:12:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:51,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 22:12:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:51,459 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:12:51,460 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:12:51,460 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,460 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 22:12:51,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716f120cbd7fd9548399f8ff96075b9166e, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716c00ca4e1b4f04436abbe9968a4d082e9] mob files 2023-07-16 22:12:51,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716f120cbd7fd9548399f8ff96075b9166e 2023-07-16 22:12:51,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716c00ca4e1b4f04436abbe9968a4d082e9 2023-07-16 22:12:51,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-16 22:12:51,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,547 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:51,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:51,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:51,548 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 22:12:51,849 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:51,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:51,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 22:12:51,850 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 22:12:51,927 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 22:12:51,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,928 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:51,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689545571221Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689545571475 (+254 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689545571475Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689545571476 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689545571480 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689545571489 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689545571927 (+438 ms) 2023-07-16 22:12:51,931 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 22:12:51,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 708 msec 2023-07-16 22:12:52,350 DEBUG [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 22:12:52,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 22:12:52,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 22:12:52,352 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352 2023-07-16 22:12:52,352 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38033, tgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352, rawTgtDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352, srcFsUri=hdfs://localhost:38033, srcDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:12:52,387 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6 2023-07-16 22:12:52,387 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2100061013_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:52,387 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38033, inputRoot=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6, snapshotDir=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-16 22:12:52,397 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:12:52,432 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,432 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,433 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,433 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,434 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,434 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,435 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,514 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/hadoop-1030740034261515556.jar 2023-07-16 22:12:52,515 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,515 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,516 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,516 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,517 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,517 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 22:12:52,518 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 22:12:52,518 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 22:12:52,519 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 22:12:52,520 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 22:12:52,520 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 22:12:52,521 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 22:12:52,521 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 22:12:52,522 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 22:12:52,522 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 22:12:52,523 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 22:12:52,523 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:52,523 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:52,524 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:52,524 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:52,524 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 22:12:52,525 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:52,525 DEBUG [Listener at jenkins-hbase4.apache.org/36941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 22:12:53,031 WARN [Listener at jenkins-hbase4.apache.org/36941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 22:12:53,033 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-16 22:12:53,036 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-16 22:12:54,140 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:54,140 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 22:12:54,147 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0006_000001 (auth:SIMPLE) 2023-07-16 22:12:54,166 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0007_000001 (auth:SIMPLE) 2023-07-16 22:12:54,987 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:12:59,905 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0007_000001 (auth:SIMPLE) 2023-07-16 22:13:02,250 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0007_000001 (auth:SIMPLE) 2023-07-16 22:13:07,526 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0007_000001 (auth:SIMPLE) 2023-07-16 22:13:09,298 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 22:13:09,298 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 22:13:09,315 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,315 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 22:13:09,316 INFO [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 22:13:09,316 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,317 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 22:13:09,317 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 22:13:09,317 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_654568294_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,317 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 22:13:09,317 DEBUG [Listener at jenkins-hbase4.apache.org/36941] snapshot.TestExportSnapshot(367): hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/export-test/export-1689545572352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 22:13:09,323 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 22:13:09,328 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545589328"}]},"ts":"1689545589328"} 2023-07-16 22:13:09,329 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-16 22:13:09,331 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-16 22:13:09,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce09c7375be061513d84c5260808ec15, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78f484b8475f4a8d14663cb60f68b6f7, UNASSIGN}] 2023-07-16 22:13:09,333 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce09c7375be061513d84c5260808ec15, UNASSIGN 2023-07-16 22:13:09,333 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78f484b8475f4a8d14663cb60f68b6f7, UNASSIGN 2023-07-16 22:13:09,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ce09c7375be061513d84c5260808ec15, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:13:09,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545589334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545589334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545589334"}]},"ts":"1689545589334"} 2023-07-16 22:13:09,334 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=78f484b8475f4a8d14663cb60f68b6f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:13:09,334 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545589334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689545589334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689545589334"}]},"ts":"1689545589334"} 2023-07-16 22:13:09,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ce09c7375be061513d84c5260808ec15, server=jenkins-hbase4.apache.org,37353,1689545452057}] 2023-07-16 22:13:09,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 78f484b8475f4a8d14663cb60f68b6f7, server=jenkins-hbase4.apache.org,38577,1689545452169}] 2023-07-16 22:13:09,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 22:13:09,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:13:09,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ce09c7375be061513d84c5260808ec15 2023-07-16 22:13:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 78f484b8475f4a8d14663cb60f68b6f7, disabling compactions & flushes 2023-07-16 22:13:09,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:13:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:13:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce09c7375be061513d84c5260808ec15, disabling compactions & flushes 2023-07-16 22:13:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. after waiting 0 ms 2023-07-16 22:13:09,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:13:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:13:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:13:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. after waiting 0 ms 2023-07-16 22:13:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:13:09,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:13:09,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:13:09,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:09,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15. 2023-07-16 22:13:09,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce09c7375be061513d84c5260808ec15: 2023-07-16 22:13:09,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:09,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7. 2023-07-16 22:13:09,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 78f484b8475f4a8d14663cb60f68b6f7: 2023-07-16 22:13:09,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ce09c7375be061513d84c5260808ec15 2023-07-16 22:13:09,509 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ce09c7375be061513d84c5260808ec15, regionState=CLOSED 2023-07-16 22:13:09,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:13:09,509 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545589509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545589509"}]},"ts":"1689545589509"} 2023-07-16 22:13:09,509 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=78f484b8475f4a8d14663cb60f68b6f7, regionState=CLOSED 2023-07-16 22:13:09,510 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689545589509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689545589509"}]},"ts":"1689545589509"} 2023-07-16 22:13:09,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-16 22:13:09,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ce09c7375be061513d84c5260808ec15, server=jenkins-hbase4.apache.org,37353,1689545452057 in 177 msec 2023-07-16 22:13:09,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-16 22:13:09,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce09c7375be061513d84c5260808ec15, UNASSIGN in 184 msec 2023-07-16 22:13:09,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 78f484b8475f4a8d14663cb60f68b6f7, server=jenkins-hbase4.apache.org,38577,1689545452169 in 177 msec 2023-07-16 22:13:09,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-16 22:13:09,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78f484b8475f4a8d14663cb60f68b6f7, UNASSIGN in 186 msec 2023-07-16 22:13:09,519 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689545589519"}]},"ts":"1689545589519"} 2023-07-16 22:13:09,520 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-16 22:13:09,522 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-16 22:13:09,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 198 msec 2023-07-16 22:13:09,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 22:13:09,630 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-16 22:13:09,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,635 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,636 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,637 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38577] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,642 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,642 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,642 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,642 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 22:13:09,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 22:13:09,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 22:13:09,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 22:13:09,643 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15 2023-07-16 22:13:09,643 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:13:09,643 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,643 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,643 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:13:09,644 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,644 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:13:09,644 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:13:09,645 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,645 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 22:13:09,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 22:13:09,646 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/recovered.edits] 2023-07-16 22:13:09,646 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf, FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/recovered.edits] 2023-07-16 22:13:09,651 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf/2041ffe2f28e4269ab53c9de48f5fd01 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/cf/2041ffe2f28e4269ab53c9de48f5fd01 2023-07-16 22:13:09,652 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf/a200b43822334393b39fee9b8e29a974 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/cf/a200b43822334393b39fee9b8e29a974 2023-07-16 22:13:09,654 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15/recovered.edits/9.seqid 2023-07-16 22:13:09,655 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce09c7375be061513d84c5260808ec15 2023-07-16 22:13:09,655 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/recovered.edits/9.seqid to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7/recovered.edits/9.seqid 2023-07-16 22:13:09,656 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78f484b8475f4a8d14663cb60f68b6f7 2023-07-16 22:13:09,656 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 22:13:09,656 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-16 22:13:09,657 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-16 22:13:09,660 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716f120cbd7fd9548399f8ff96075b9166e to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716f120cbd7fd9548399f8ff96075b9166e 2023-07-16 22:13:09,662 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716c00ca4e1b4f04436abbe9968a4d082e9 to hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716c00ca4e1b4f04436abbe9968a4d082e9 2023-07-16 22:13:09,662 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-16 22:13:09,664 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,666 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-16 22:13:09,668 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-16 22:13:09,670 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,670 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-16 22:13:09,670 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545589670"}]},"ts":"9223372036854775807"} 2023-07-16 22:13:09,670 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689545589670"}]},"ts":"9223372036854775807"} 2023-07-16 22:13:09,672 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 22:13:09,672 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ce09c7375be061513d84c5260808ec15, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689545569683.ce09c7375be061513d84c5260808ec15.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 78f484b8475f4a8d14663cb60f68b6f7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689545569683.78f484b8475f4a8d14663cb60f68b6f7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 22:13:09,672 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-16 22:13:09,672 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689545589672"}]},"ts":"9223372036854775807"} 2023-07-16 22:13:09,676 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-16 22:13:09,678 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 47 msec 2023-07-16 22:13:09,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 22:13:09,748 INFO [Listener at jenkins-hbase4.apache.org/36941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-16 22:13:09,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 22:13:09,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 22:13:09,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35007] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 22:13:09,794 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 761) Potentially hanging thread: Thread-5545 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:38840 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:43311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:58750 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b642fce-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_654568294_17 at /127.0.0.1:51154 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_481659698_1 at /127.0.0.1:58730 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_481659698_1 at /127.0.0.1:38820 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=667 (was 609) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 183), AvailableMemoryMB=1125 (was 1378) 2023-07-16 22:13:09,794 WARN [Listener at jenkins-hbase4.apache.org/36941] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 22:13:09,794 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-16 22:13:09,811 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 22:13:13,723 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689545459911_0007_000001 (auth:SIMPLE) 2023-07-16 22:13:15,075 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 22:13:23,935 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 22:13:38,050 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 22:13:38,050 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 22:13:38,162 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-16 22:13:38,174 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-16 22:13:38,176 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 22:13:38,185 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 22:13:38,289 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 22:13:38,290 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-16 22:13:38,290 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-16 22:13:38,290 INFO [Listener at jenkins-hbase4.apache.org/36941] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-16 22:13:38,290 DEBUG [Listener at jenkins-hbase4.apache.org/36941] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x722ff5ad to 127.0.0.1:58223 2023-07-16 22:13:38,290 DEBUG [Listener at jenkins-hbase4.apache.org/36941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,290 DEBUG [Listener at jenkins-hbase4.apache.org/36941] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-16 22:13:38,291 DEBUG [Listener at jenkins-hbase4.apache.org/36941] util.JVMClusterUtil(257): Found active master hash=1010112837, stopped=false 2023-07-16 22:13:38,291 DEBUG [Listener at jenkins-hbase4.apache.org/36941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:38,291 DEBUG [Listener at jenkins-hbase4.apache.org/36941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 22:13:38,291 INFO [Listener at jenkins-hbase4.apache.org/36941] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:13:38,292 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 22:13:38,292 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 22:13:38,292 INFO [Listener at jenkins-hbase4.apache.org/36941] procedure2.ProcedureExecutor(629): Stopping 2023-07-16 22:13:38,292 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 22:13:38,292 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 22:13:38,293 DEBUG [Listener at jenkins-hbase4.apache.org/36941] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09ffcd75 to 127.0.0.1:58223 2023-07-16 22:13:38,293 DEBUG [Listener at jenkins-hbase4.apache.org/36941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,293 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:13:38,293 INFO [Listener at jenkins-hbase4.apache.org/36941] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37353,1689545452057' ***** 2023-07-16 22:13:38,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:13:38,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:13:38,294 DEBUG [Listener at jenkins-hbase4.apache.org/36941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:38,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:13:38,294 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1064): Closing user regions 2023-07-16 22:13:38,294 INFO [Listener at jenkins-hbase4.apache.org/36941] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 22:13:38,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 22:13:38,294 INFO [Listener at jenkins-hbase4.apache.org/36941] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41119,1689545452128' ***** 2023-07-16 22:13:38,294 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(3305): Received CLOSE for f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:13:38,294 DEBUG [Listener at jenkins-hbase4.apache.org/36941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:38,294 INFO [RS:0;jenkins-hbase4:37353] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 22:13:38,294 INFO [Listener at jenkins-hbase4.apache.org/36941] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 22:13:38,294 INFO [Listener at jenkins-hbase4.apache.org/36941] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38577,1689545452169' ***** 2023-07-16 22:13:38,294 DEBUG [Listener at jenkins-hbase4.apache.org/36941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:38,294 INFO [RS:0;jenkins-hbase4:37353] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 22:13:38,294 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 22:13:38,294 INFO [Listener at jenkins-hbase4.apache.org/36941] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 22:13:38,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2cbbf37e8c21240601e65766913f0f1, disabling compactions & flushes 2023-07-16 22:13:38,295 INFO [RS:0;jenkins-hbase4:37353] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 22:13:38,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:13:38,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:13:38,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. after waiting 0 ms 2023-07-16 22:13:38,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:13:38,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f2cbbf37e8c21240601e65766913f0f1 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-16 22:13:38,296 INFO [RS:1;jenkins-hbase4:41119] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 22:13:38,296 INFO [RS:1;jenkins-hbase4:41119] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 22:13:38,296 INFO [RS:1;jenkins-hbase4:41119] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 22:13:38,296 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:13:38,296 INFO [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:13:38,296 INFO [RS:2;jenkins-hbase4:38577] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 22:13:38,296 DEBUG [RS:0;jenkins-hbase4:37353] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77f88667 to 127.0.0.1:58223 2023-07-16 22:13:38,296 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 22:13:38,296 DEBUG [RS:1;jenkins-hbase4:41119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26cc8938 to 127.0.0.1:58223 2023-07-16 22:13:38,296 DEBUG [RS:1;jenkins-hbase4:41119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,296 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 22:13:38,296 DEBUG [RS:0;jenkins-hbase4:37353] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,299 INFO [RS:1;jenkins-hbase4:41119] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 22:13:38,299 INFO [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37353,1689545452057; all regions closed. 2023-07-16 22:13:38,296 INFO [RS:2;jenkins-hbase4:38577] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 22:13:38,300 INFO [RS:2;jenkins-hbase4:38577] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 22:13:38,299 INFO [RS:1;jenkins-hbase4:41119] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 22:13:38,300 INFO [RS:1;jenkins-hbase4:41119] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 22:13:38,300 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(3305): Received CLOSE for a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:13:38,300 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-16 22:13:38,300 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:13:38,300 DEBUG [RS:2;jenkins-hbase4:38577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x528fe738 to 127.0.0.1:58223 2023-07-16 22:13:38,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a3c7c834823bb54b459e196aec7c7c45, disabling compactions & flushes 2023-07-16 22:13:38,300 DEBUG [RS:2;jenkins-hbase4:38577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,301 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-16 22:13:38,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:13:38,302 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1478): Online Regions={f2cbbf37e8c21240601e65766913f0f1=hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1., 1588230740=hbase:meta,,1.1588230740} 2023-07-16 22:13:38,302 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 22:13:38,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:13:38,302 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1478): Online Regions={a3c7c834823bb54b459e196aec7c7c45=hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45.} 2023-07-16 22:13:38,303 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 22:13:38,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. after waiting 0 ms 2023-07-16 22:13:38,304 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 22:13:38,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:13:38,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a3c7c834823bb54b459e196aec7c7c45 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-16 22:13:38,304 DEBUG [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1504): Waiting on a3c7c834823bb54b459e196aec7c7c45 2023-07-16 22:13:38,304 DEBUG [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1504): Waiting on 1588230740, f2cbbf37e8c21240601e65766913f0f1 2023-07-16 22:13:38,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 22:13:38,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 22:13:38,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 22:13:38,304 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-16 22:13:38,318 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:38,323 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:38,323 DEBUG [RS:0;jenkins-hbase4:37353] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/oldWALs 2023-07-16 22:13:38,323 INFO [RS:0;jenkins-hbase4:37353] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37353%2C1689545452057:(num 1689545454322) 2023-07-16 22:13:38,324 DEBUG [RS:0;jenkins-hbase4:37353] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,324 INFO [RS:0;jenkins-hbase4:37353] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:38,326 INFO [RS:0;jenkins-hbase4:37353] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 22:13:38,328 INFO [RS:0;jenkins-hbase4:37353] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 22:13:38,328 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 22:13:38,328 INFO [RS:0;jenkins-hbase4:37353] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 22:13:38,328 INFO [RS:0;jenkins-hbase4:37353] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 22:13:38,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1/.tmp/info/8f6cbb1b7a984c9f8454136c1ba624ab 2023-07-16 22:13:38,330 INFO [RS:0;jenkins-hbase4:37353] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37353 2023-07-16 22:13:38,332 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:38,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45/.tmp/l/0e275e17cd924fe79866643160200eb7 2023-07-16 22:13:38,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/.tmp/info/1516f09034824eb7b983007e5f02a420 2023-07-16 22:13:38,336 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:13:38,336 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:38,336 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:38,336 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:13:38,336 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37353,1689545452057 2023-07-16 22:13:38,337 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:38,337 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:38,338 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37353,1689545452057] 2023-07-16 22:13:38,339 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37353,1689545452057; numProcessing=1 2023-07-16 22:13:38,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1/.tmp/info/8f6cbb1b7a984c9f8454136c1ba624ab as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1/info/8f6cbb1b7a984c9f8454136c1ba624ab 2023-07-16 22:13:38,341 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37353,1689545452057 already deleted, retry=false 2023-07-16 22:13:38,341 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37353,1689545452057 expired; onlineServers=2 2023-07-16 22:13:38,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e275e17cd924fe79866643160200eb7 2023-07-16 22:13:38,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1516f09034824eb7b983007e5f02a420 2023-07-16 22:13:38,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45/.tmp/l/0e275e17cd924fe79866643160200eb7 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45/l/0e275e17cd924fe79866643160200eb7 2023-07-16 22:13:38,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1/info/8f6cbb1b7a984c9f8454136c1ba624ab, entries=2, sequenceid=6, filesize=4.8 K 2023-07-16 22:13:38,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f2cbbf37e8c21240601e65766913f0f1 in 49ms, sequenceid=6, compaction requested=false 2023-07-16 22:13:38,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/namespace/f2cbbf37e8c21240601e65766913f0f1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 22:13:38,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e275e17cd924fe79866643160200eb7 2023-07-16 22:13:38,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45/l/0e275e17cd924fe79866643160200eb7, entries=7, sequenceid=18, filesize=5.2 K 2023-07-16 22:13:38,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:38,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:13:38,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2cbbf37e8c21240601e65766913f0f1: 2023-07-16 22:13:38,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689545454913.f2cbbf37e8c21240601e65766913f0f1. 2023-07-16 22:13:38,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a3c7c834823bb54b459e196aec7c7c45 in 47ms, sequenceid=18, compaction requested=false 2023-07-16 22:13:38,355 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/.tmp/rep_barrier/50cc6090455b4e068ce05a5cc9726497 2023-07-16 22:13:38,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50cc6090455b4e068ce05a5cc9726497 2023-07-16 22:13:38,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/acl/a3c7c834823bb54b459e196aec7c7c45/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-16 22:13:38,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:38,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:13:38,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a3c7c834823bb54b459e196aec7c7c45: 2023-07-16 22:13:38,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689545455775.a3c7c834823bb54b459e196aec7c7c45. 2023-07-16 22:13:38,372 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/.tmp/table/c56ec22f9deb46a292ee2de1669689bf 2023-07-16 22:13:38,375 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c56ec22f9deb46a292ee2de1669689bf 2023-07-16 22:13:38,376 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/.tmp/info/1516f09034824eb7b983007e5f02a420 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/info/1516f09034824eb7b983007e5f02a420 2023-07-16 22:13:38,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1516f09034824eb7b983007e5f02a420 2023-07-16 22:13:38,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/info/1516f09034824eb7b983007e5f02a420, entries=48, sequenceid=131, filesize=10.3 K 2023-07-16 22:13:38,381 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/.tmp/rep_barrier/50cc6090455b4e068ce05a5cc9726497 as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/rep_barrier/50cc6090455b4e068ce05a5cc9726497 2023-07-16 22:13:38,385 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50cc6090455b4e068ce05a5cc9726497 2023-07-16 22:13:38,385 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/rep_barrier/50cc6090455b4e068ce05a5cc9726497, entries=13, sequenceid=131, filesize=6.4 K 2023-07-16 22:13:38,386 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/.tmp/table/c56ec22f9deb46a292ee2de1669689bf as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/table/c56ec22f9deb46a292ee2de1669689bf 2023-07-16 22:13:38,390 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c56ec22f9deb46a292ee2de1669689bf 2023-07-16 22:13:38,390 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/table/c56ec22f9deb46a292ee2de1669689bf, entries=24, sequenceid=131, filesize=6.9 K 2023-07-16 22:13:38,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 87ms, sequenceid=131, compaction requested=false 2023-07-16 22:13:38,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-16 22:13:38,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 22:13:38,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 22:13:38,407 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 22:13:38,407 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 22:13:38,407 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-16 22:13:38,440 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:38,440 INFO [RS:0;jenkins-hbase4:37353] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37353,1689545452057; zookeeper connection closed. 2023-07-16 22:13:38,440 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:37353-0x101703023b70001, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:38,440 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73675a1e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73675a1e 2023-07-16 22:13:38,504 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38577,1689545452169; all regions closed. 2023-07-16 22:13:38,504 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41119,1689545452128; all regions closed. 2023-07-16 22:13:38,511 DEBUG [RS:2;jenkins-hbase4:38577] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/oldWALs 2023-07-16 22:13:38,511 DEBUG [RS:1;jenkins-hbase4:41119] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/oldWALs 2023-07-16 22:13:38,511 INFO [RS:2;jenkins-hbase4:38577] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38577%2C1689545452169:(num 1689545454342) 2023-07-16 22:13:38,511 DEBUG [RS:2;jenkins-hbase4:38577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,511 INFO [RS:1;jenkins-hbase4:41119] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41119%2C1689545452128.meta:.meta(num 1689545454546) 2023-07-16 22:13:38,511 INFO [RS:2;jenkins-hbase4:38577] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:38,511 INFO [RS:2;jenkins-hbase4:38577] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 22:13:38,512 INFO [RS:2;jenkins-hbase4:38577] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 22:13:38,512 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 22:13:38,512 INFO [RS:2;jenkins-hbase4:38577] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 22:13:38,512 INFO [RS:2;jenkins-hbase4:38577] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 22:13:38,513 INFO [RS:2;jenkins-hbase4:38577] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38577 2023-07-16 22:13:38,514 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:13:38,514 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:38,514 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38577,1689545452169 2023-07-16 22:13:38,515 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38577,1689545452169] 2023-07-16 22:13:38,516 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38577,1689545452169; numProcessing=2 2023-07-16 22:13:38,518 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38577,1689545452169 already deleted, retry=false 2023-07-16 22:13:38,518 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38577,1689545452169 expired; onlineServers=1 2023-07-16 22:13:38,519 DEBUG [RS:1;jenkins-hbase4:41119] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/oldWALs 2023-07-16 22:13:38,519 INFO [RS:1;jenkins-hbase4:41119] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41119%2C1689545452128:(num 1689545454346) 2023-07-16 22:13:38,519 DEBUG [RS:1;jenkins-hbase4:41119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,519 INFO [RS:1;jenkins-hbase4:41119] regionserver.LeaseManager(133): Closed leases 2023-07-16 22:13:38,519 INFO [RS:1;jenkins-hbase4:41119] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-16 22:13:38,519 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 22:13:38,520 INFO [RS:1;jenkins-hbase4:41119] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41119 2023-07-16 22:13:38,521 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41119,1689545452128 2023-07-16 22:13:38,521 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 22:13:38,522 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41119,1689545452128] 2023-07-16 22:13:38,522 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41119,1689545452128; numProcessing=3 2023-07-16 22:13:38,523 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41119,1689545452128 already deleted, retry=false 2023-07-16 22:13:38,523 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41119,1689545452128 expired; onlineServers=0 2023-07-16 22:13:38,524 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35007,1689545450581' ***** 2023-07-16 22:13:38,524 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-16 22:13:38,524 DEBUG [M:0;jenkins-hbase4:35007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d08137e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 22:13:38,524 INFO [M:0;jenkins-hbase4:35007] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35007,1689545450581 2023-07-16 22:13:38,524 INFO [M:0;jenkins-hbase4:35007] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35007,1689545450581; all regions closed. 2023-07-16 22:13:38,524 DEBUG [M:0;jenkins-hbase4:35007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 22:13:38,524 DEBUG [M:0;jenkins-hbase4:35007] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-16 22:13:38,524 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-16 22:13:38,524 DEBUG [M:0;jenkins-hbase4:35007] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-16 22:13:38,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689545453821] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689545453821,5,FailOnTimeoutGroup] 2023-07-16 22:13:38,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689545453821] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689545453821,5,FailOnTimeoutGroup] 2023-07-16 22:13:38,524 INFO [M:0;jenkins-hbase4:35007] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-16 22:13:38,524 INFO [M:0;jenkins-hbase4:35007] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-16 22:13:38,524 INFO [M:0;jenkins-hbase4:35007] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-16 22:13:38,525 DEBUG [M:0;jenkins-hbase4:35007] master.HMaster(1512): Stopping service threads 2023-07-16 22:13:38,525 INFO [M:0;jenkins-hbase4:35007] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-16 22:13:38,525 ERROR [M:0;jenkins-hbase4:35007] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-16 22:13:38,525 INFO [M:0;jenkins-hbase4:35007] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-16 22:13:38,526 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-16 22:13:38,527 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-16 22:13:38,527 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 22:13:38,527 DEBUG [M:0;jenkins-hbase4:35007] zookeeper.ZKUtil(398): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-16 22:13:38,527 WARN [M:0;jenkins-hbase4:35007] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-16 22:13:38,527 INFO [M:0;jenkins-hbase4:35007] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-16 22:13:38,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 22:13:38,527 INFO [M:0;jenkins-hbase4:35007] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-16 22:13:38,528 DEBUG [M:0;jenkins-hbase4:35007] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 22:13:38,528 INFO [M:0;jenkins-hbase4:35007] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:13:38,528 DEBUG [M:0;jenkins-hbase4:35007] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:13:38,528 DEBUG [M:0;jenkins-hbase4:35007] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 22:13:38,528 DEBUG [M:0;jenkins-hbase4:35007] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:13:38,528 INFO [M:0;jenkins-hbase4:35007] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.91 KB heapSize=452.15 KB 2023-07-16 22:13:38,555 INFO [M:0;jenkins-hbase4:35007] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.91 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/474f751a0db34cb39ac00228dd769a8c 2023-07-16 22:13:38,560 INFO [M:0;jenkins-hbase4:35007] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 474f751a0db34cb39ac00228dd769a8c 2023-07-16 22:13:38,561 DEBUG [M:0;jenkins-hbase4:35007] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/474f751a0db34cb39ac00228dd769a8c as hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/474f751a0db34cb39ac00228dd769a8c 2023-07-16 22:13:38,566 INFO [M:0;jenkins-hbase4:35007] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 474f751a0db34cb39ac00228dd769a8c 2023-07-16 22:13:38,566 INFO [M:0;jenkins-hbase4:35007] regionserver.HStore(1080): Added hdfs://localhost:38033/user/jenkins/test-data/881f4dc1-dd77-97e8-984c-212bf53a1dd6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/474f751a0db34cb39ac00228dd769a8c, entries=119, sequenceid=899, filesize=28.7 K 2023-07-16 22:13:38,567 INFO [M:0;jenkins-hbase4:35007] regionserver.HRegion(2948): Finished flush of dataSize ~375.91 KB/384936, heapSize ~452.13 KB/462984, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 39ms, sequenceid=899, compaction requested=false 2023-07-16 22:13:38,574 INFO [M:0;jenkins-hbase4:35007] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 22:13:38,574 DEBUG [M:0;jenkins-hbase4:35007] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 22:13:38,580 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 22:13:38,580 INFO [M:0;jenkins-hbase4:35007] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-16 22:13:38,581 INFO [M:0;jenkins-hbase4:35007] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35007 2023-07-16 22:13:38,583 DEBUG [M:0;jenkins-hbase4:35007] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35007,1689545450581 already deleted, retry=false 2023-07-16 22:13:38,616 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:38,616 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:38577-0x101703023b70003, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:38,616 INFO [RS:2;jenkins-hbase4:38577] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38577,1689545452169; zookeeper connection closed. 2023-07-16 22:13:38,616 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2b99203e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2b99203e 2023-07-16 22:13:38,716 INFO [M:0;jenkins-hbase4:35007] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35007,1689545450581; zookeeper connection closed. 2023-07-16 22:13:38,716 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:38,716 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): master:35007-0x101703023b70000, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:38,816 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:38,817 DEBUG [Listener at localhost/46301-EventThread] zookeeper.ZKWatcher(600): regionserver:41119-0x101703023b70002, quorum=127.0.0.1:58223, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 22:13:38,817 INFO [RS:1;jenkins-hbase4:41119] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41119,1689545452128; zookeeper connection closed. 2023-07-16 22:13:38,827 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@15bfe688] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@15bfe688 2023-07-16 22:13:38,827 INFO [Listener at jenkins-hbase4.apache.org/36941] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-16 22:13:38,827 WARN [Listener at jenkins-hbase4.apache.org/36941] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 22:13:38,860 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 22:13:38,874 WARN [BP-1508035521-172.31.14.131-1689545446556 heartbeating to localhost/127.0.0.1:38033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 22:13:38,875 WARN [BP-1508035521-172.31.14.131-1689545446556 heartbeating to localhost/127.0.0.1:38033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1508035521-172.31.14.131-1689545446556 (Datanode Uuid 5db885e4-4bb1-41de-a183-67c7eec14ce9) service to localhost/127.0.0.1:38033 2023-07-16 22:13:38,877 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data6/current/BP-1508035521-172.31.14.131-1689545446556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:38,877 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data5/current/BP-1508035521-172.31.14.131-1689545446556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:38,879 WARN [Listener at jenkins-hbase4.apache.org/36941] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 22:13:38,900 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 22:13:39,007 WARN [BP-1508035521-172.31.14.131-1689545446556 heartbeating to localhost/127.0.0.1:38033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 22:13:39,007 WARN [BP-1508035521-172.31.14.131-1689545446556 heartbeating to localhost/127.0.0.1:38033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1508035521-172.31.14.131-1689545446556 (Datanode Uuid f9b02a95-ed46-4d5c-afae-b4df71efec0b) service to localhost/127.0.0.1:38033 2023-07-16 22:13:39,009 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data4/current/BP-1508035521-172.31.14.131-1689545446556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:39,009 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data3/current/BP-1508035521-172.31.14.131-1689545446556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:39,010 WARN [Listener at jenkins-hbase4.apache.org/36941] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 22:13:39,037 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 22:13:39,043 WARN [BP-1508035521-172.31.14.131-1689545446556 heartbeating to localhost/127.0.0.1:38033] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 22:13:39,043 WARN [BP-1508035521-172.31.14.131-1689545446556 heartbeating to localhost/127.0.0.1:38033] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1508035521-172.31.14.131-1689545446556 (Datanode Uuid 65506098-fcf5-4b41-b48b-b73fdcd5bc92) service to localhost/127.0.0.1:38033 2023-07-16 22:13:39,044 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data1/current/BP-1508035521-172.31.14.131-1689545446556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:39,044 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a106566a-428a-46f9-b646-8000bff16825/cluster_ccc16a55-0500-b448-9ce2-c1ef7be3bc7e/dfs/data/data2/current/BP-1508035521-172.31.14.131-1689545446556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 22:13:39,100 INFO [Listener at jenkins-hbase4.apache.org/36941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 22:13:39,240 INFO [Listener at jenkins-hbase4.apache.org/36941] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-16 22:13:39,372 INFO [Listener at jenkins-hbase4.apache.org/36941] hbase.HBaseTestingUtility(1293): Minicluster is down