2023-09-22 23:01:53,830 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-22 23:01:54,052 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e 2023-09-22 23:01:54,053 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-22 23:01:54,053 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-22 23:01:54,093 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-22 23:01:54,341 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-22 23:01:54,341 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d, deleteOnExit=true 2023-09-22 23:01:54,341 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-22 23:01:54,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/test.cache.data in system properties and HBase conf 2023-09-22 23:01:54,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop.tmp.dir in system properties and HBase conf 2023-09-22 23:01:54,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop.log.dir in system properties and HBase conf 2023-09-22 23:01:54,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-22 23:01:54,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-22 23:01:54,344 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-22 23:01:54,663 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-22 23:01:54,668 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-22 23:01:54,668 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-22 23:01:54,668 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-22 23:01:54,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 23:01:54,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-22 23:01:54,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-22 23:01:54,670 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 23:01:54,670 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 23:01:54,671 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-22 23:01:54,671 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/nfs.dump.dir in system properties and HBase conf 2023-09-22 23:01:54,671 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir in system properties and HBase conf 2023-09-22 23:01:54,672 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 23:01:54,672 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-22 23:01:54,673 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-22 23:01:55,205 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-22 23:01:55,210 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-22 23:01:55,520 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-22 23:01:55,695 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-22 23:01:55,712 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 23:01:55,750 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 23:01:55,784 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir/Jetty_localhost_41757_hdfs____.voewnu/webapp 2023-09-22 23:01:55,942 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41757 2023-09-22 23:01:55,982 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-22 23:01:55,983 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-22 23:01:56,452 WARN [Listener at localhost/34671] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 23:01:56,540 WARN [Listener at localhost/34671] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 23:01:56,562 WARN [Listener at localhost/34671] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 23:01:56,570 INFO [Listener at localhost/34671] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 23:01:56,576 INFO [Listener at localhost/34671] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir/Jetty_localhost_45323_datanode____efuvi2/webapp 2023-09-22 23:01:56,671 INFO [Listener at localhost/34671] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45323 2023-09-22 23:01:57,099 WARN [Listener at localhost/40847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 23:01:57,113 WARN [Listener at localhost/40847] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 23:01:57,117 WARN [Listener at localhost/40847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 23:01:57,119 INFO [Listener at localhost/40847] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 23:01:57,132 INFO [Listener at localhost/40847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir/Jetty_localhost_41377_datanode____.d01083/webapp 2023-09-22 23:01:57,237 INFO [Listener at localhost/40847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41377 2023-09-22 23:01:57,246 WARN [Listener at localhost/36405] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 23:01:57,259 WARN [Listener at localhost/36405] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 23:01:57,262 WARN [Listener at localhost/36405] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 23:01:57,264 INFO [Listener at localhost/36405] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 23:01:57,269 INFO [Listener at localhost/36405] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir/Jetty_localhost_45925_datanode____c9lvnm/webapp 2023-09-22 23:01:57,379 INFO [Listener at localhost/36405] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45925 2023-09-22 23:01:57,390 WARN [Listener at localhost/35385] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 23:01:57,671 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd76d05622621a9f4: Processing first storage report for DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e from datanode ddc604b7-4ac5-418b-914c-b46819531879 2023-09-22 23:01:57,673 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd76d05622621a9f4: from storage DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e node DatanodeRegistration(127.0.0.1:45745, datanodeUuid=ddc604b7-4ac5-418b-914c-b46819531879, infoPort=36157, infoSecurePort=0, ipcPort=36405, storageInfo=lv=-57;cid=testClusterID;nsid=255863269;c=1695423715293), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-09-22 23:01:57,674 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x25ec600b2a71bcc7: Processing first storage report for DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8 from datanode e61268c9-b787-4a84-953e-b189f68c8695 2023-09-22 23:01:57,674 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x25ec600b2a71bcc7: from storage DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8 node DatanodeRegistration(127.0.0.1:33393, datanodeUuid=e61268c9-b787-4a84-953e-b189f68c8695, infoPort=38755, infoSecurePort=0, ipcPort=35385, storageInfo=lv=-57;cid=testClusterID;nsid=255863269;c=1695423715293), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 23:01:57,674 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8382f0981c0cf16a: Processing first storage report for DS-2328105b-5540-4f5b-a79e-cef7bb2a611c from datanode a8069c17-9a38-417e-8948-6db93b1f8ea2 2023-09-22 23:01:57,674 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8382f0981c0cf16a: from storage DS-2328105b-5540-4f5b-a79e-cef7bb2a611c node DatanodeRegistration(127.0.0.1:41165, datanodeUuid=a8069c17-9a38-417e-8948-6db93b1f8ea2, infoPort=34285, infoSecurePort=0, ipcPort=40847, storageInfo=lv=-57;cid=testClusterID;nsid=255863269;c=1695423715293), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 23:01:57,675 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd76d05622621a9f4: Processing first storage report for DS-9fe3416f-15e7-46d1-aee0-9e3bd5dd5413 from datanode ddc604b7-4ac5-418b-914c-b46819531879 2023-09-22 23:01:57,675 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd76d05622621a9f4: from storage DS-9fe3416f-15e7-46d1-aee0-9e3bd5dd5413 node DatanodeRegistration(127.0.0.1:45745, datanodeUuid=ddc604b7-4ac5-418b-914c-b46819531879, infoPort=36157, infoSecurePort=0, ipcPort=36405, storageInfo=lv=-57;cid=testClusterID;nsid=255863269;c=1695423715293), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 23:01:57,675 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x25ec600b2a71bcc7: Processing first storage report for DS-2ead4c79-bab0-4ee3-854a-728f644df1d3 from datanode e61268c9-b787-4a84-953e-b189f68c8695 2023-09-22 23:01:57,675 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x25ec600b2a71bcc7: from storage DS-2ead4c79-bab0-4ee3-854a-728f644df1d3 node DatanodeRegistration(127.0.0.1:33393, datanodeUuid=e61268c9-b787-4a84-953e-b189f68c8695, infoPort=38755, infoSecurePort=0, ipcPort=35385, storageInfo=lv=-57;cid=testClusterID;nsid=255863269;c=1695423715293), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 23:01:57,675 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8382f0981c0cf16a: Processing first storage report for DS-a67851b8-9f83-4221-9696-d5426e77d9f5 from datanode a8069c17-9a38-417e-8948-6db93b1f8ea2 2023-09-22 23:01:57,676 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8382f0981c0cf16a: from storage DS-a67851b8-9f83-4221-9696-d5426e77d9f5 node DatanodeRegistration(127.0.0.1:41165, datanodeUuid=a8069c17-9a38-417e-8948-6db93b1f8ea2, infoPort=34285, infoSecurePort=0, ipcPort=40847, storageInfo=lv=-57;cid=testClusterID;nsid=255863269;c=1695423715293), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 23:01:57,909 DEBUG [Listener at localhost/35385] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e 2023-09-22 23:01:58,005 INFO [Listener at localhost/35385] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/zookeeper_0, clientPort=57942, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-22 23:01:58,026 INFO [Listener at localhost/35385] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57942 2023-09-22 23:01:58,036 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:01:58,038 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:01:58,733 INFO [Listener at localhost/35385] util.FSUtils(471): Created version file at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 with version=8 2023-09-22 23:01:58,733 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/hbase-staging 2023-09-22 23:01:59,100 INFO [Listener at localhost/35385] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-22 23:01:59,562 INFO [Listener at localhost/35385] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-22 23:01:59,594 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 23:01:59,595 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 23:01:59,595 INFO [Listener at localhost/35385] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 23:01:59,595 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 23:01:59,595 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 23:01:59,737 INFO [Listener at localhost/35385] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 23:01:59,811 DEBUG [Listener at localhost/35385] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-22 23:01:59,908 INFO [Listener at localhost/35385] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46029 2023-09-22 23:01:59,921 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:01:59,923 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:01:59,950 INFO [Listener at localhost/35385] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46029 connecting to ZooKeeper ensemble=127.0.0.1:57942 2023-09-22 23:02:00,005 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:460290x0, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 23:02:00,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46029-0x100d5e01a070000 connected 2023-09-22 23:02:00,039 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 23:02:00,040 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 23:02:00,058 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 23:02:00,070 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46029 2023-09-22 23:02:00,070 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46029 2023-09-22 23:02:00,071 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46029 2023-09-22 23:02:00,072 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46029 2023-09-22 23:02:00,072 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46029 2023-09-22 23:02:00,079 INFO [Listener at localhost/35385] master.HMaster(444): hbase.rootdir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0, hbase.cluster.distributed=false 2023-09-22 23:02:00,144 INFO [Listener at localhost/35385] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-22 23:02:00,144 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,144 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,145 INFO [Listener at localhost/35385] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 23:02:00,145 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,145 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 23:02:00,150 INFO [Listener at localhost/35385] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 23:02:00,152 INFO [Listener at localhost/35385] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37507 2023-09-22 23:02:00,155 INFO [Listener at localhost/35385] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 23:02:00,161 INFO [Listener at localhost/35385] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 23:02:00,163 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:02:00,164 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:02:00,166 INFO [Listener at localhost/35385] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37507 connecting to ZooKeeper ensemble=127.0.0.1:57942 2023-09-22 23:02:00,170 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:375070x0, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 23:02:00,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37507-0x100d5e01a070001 connected 2023-09-22 23:02:00,171 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 23:02:00,173 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 23:02:00,173 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 23:02:00,174 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37507 2023-09-22 23:02:00,174 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37507 2023-09-22 23:02:00,177 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37507 2023-09-22 23:02:00,177 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37507 2023-09-22 23:02:00,177 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37507 2023-09-22 23:02:00,190 INFO [Listener at localhost/35385] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-22 23:02:00,190 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,191 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,191 INFO [Listener at localhost/35385] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 23:02:00,191 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,191 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 23:02:00,192 INFO [Listener at localhost/35385] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 23:02:00,194 INFO [Listener at localhost/35385] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38937 2023-09-22 23:02:00,194 INFO [Listener at localhost/35385] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 23:02:00,195 INFO [Listener at localhost/35385] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 23:02:00,196 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:02:00,198 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:02:00,201 INFO [Listener at localhost/35385] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38937 connecting to ZooKeeper ensemble=127.0.0.1:57942 2023-09-22 23:02:00,207 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:389370x0, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 23:02:00,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38937-0x100d5e01a070002 connected 2023-09-22 23:02:00,208 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 23:02:00,209 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 23:02:00,210 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 23:02:00,211 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38937 2023-09-22 23:02:00,211 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38937 2023-09-22 23:02:00,211 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38937 2023-09-22 23:02:00,212 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38937 2023-09-22 23:02:00,212 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38937 2023-09-22 23:02:00,224 INFO [Listener at localhost/35385] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-22 23:02:00,224 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,224 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,224 INFO [Listener at localhost/35385] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 23:02:00,224 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 23:02:00,224 INFO [Listener at localhost/35385] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 23:02:00,225 INFO [Listener at localhost/35385] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 23:02:00,226 INFO [Listener at localhost/35385] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40697 2023-09-22 23:02:00,226 INFO [Listener at localhost/35385] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 23:02:00,227 INFO [Listener at localhost/35385] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 23:02:00,228 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:02:00,230 INFO [Listener at localhost/35385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:02:00,232 INFO [Listener at localhost/35385] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40697 connecting to ZooKeeper ensemble=127.0.0.1:57942 2023-09-22 23:02:00,235 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:406970x0, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 23:02:00,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40697-0x100d5e01a070003 connected 2023-09-22 23:02:00,236 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 23:02:00,237 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 23:02:00,238 DEBUG [Listener at localhost/35385] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 23:02:00,239 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40697 2023-09-22 23:02:00,239 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40697 2023-09-22 23:02:00,241 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40697 2023-09-22 23:02:00,241 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40697 2023-09-22 23:02:00,245 DEBUG [Listener at localhost/35385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40697 2023-09-22 23:02:00,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:02:00,260 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-22 23:02:00,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:02:00,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 23:02:00,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 23:02:00,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:00,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 23:02:00,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 23:02:00,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-22 23:02:00,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-22 23:02:00,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46029,1695423718942 from backup master directory 2023-09-22 23:02:00,296 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:02:00,296 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-22 23:02:00,297 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 23:02:00,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:02:00,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-22 23:02:00,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-22 23:02:00,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/hbase.id with ID: 2dafb648-6ea3-46f0-b301-34bf7b5a5d8a 2023-09-22 23:02:00,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 23:02:00,453 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:00,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1544823e to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:00,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46ccfe0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:00,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-22 23:02:00,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-22 23:02:00,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-22 23:02:00,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-22 23:02:00,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-22 23:02:00,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-22 23:02:00,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 23:02:00,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store-tmp 2023-09-22 23:02:00,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:00,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-22 23:02:00,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 23:02:00,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 23:02:00,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-22 23:02:00,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 23:02:00,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 23:02:00,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 23:02:00,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/WALs/jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:02:00,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46029%2C1695423718942, suffix=, logDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/WALs/jenkins-hbase4.apache.org,46029,1695423718942, archiveDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/oldWALs, maxLogs=10 2023-09-22 23:02:00,747 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK] 2023-09-22 23:02:00,747 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK] 2023-09-22 23:02:00,747 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK] 2023-09-22 23:02:00,755 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-22 23:02:00,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/WALs/jenkins-hbase4.apache.org,46029,1695423718942/jenkins-hbase4.apache.org%2C46029%2C1695423718942.1695423720696 2023-09-22 23:02:00,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK], DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK], DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK]] 2023-09-22 23:02:00,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-22 23:02:00,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:00,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 23:02:00,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 23:02:00,917 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-22 23:02:00,926 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-22 23:02:00,965 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-22 23:02:00,978 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:00,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-22 23:02:00,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-22 23:02:01,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 23:02:01,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:01,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60225703, jitterRate=-0.10256709158420563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:01,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 23:02:01,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-22 23:02:01,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-22 23:02:01,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-22 23:02:01,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-22 23:02:01,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-22 23:02:01,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-22 23:02:01,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-22 23:02:01,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-22 23:02:01,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-22 23:02:01,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-22 23:02:01,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-22 23:02:01,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-22 23:02:01,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-22 23:02:01,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-22 23:02:01,156 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:01,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-22 23:02:01,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-22 23:02:01,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-22 23:02:01,183 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 23:02:01,183 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 23:02:01,183 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 23:02:01,183 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:01,183 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 23:02:01,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46029,1695423718942, sessionid=0x100d5e01a070000, setting cluster-up flag (Was=false) 2023-09-22 23:02:01,206 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:01,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-22 23:02:01,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:02:01,225 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:01,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-22 23:02:01,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:02:01,236 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp 2023-09-22 23:02:01,249 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(951): ClusterId : 2dafb648-6ea3-46f0-b301-34bf7b5a5d8a 2023-09-22 23:02:01,249 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(951): ClusterId : 2dafb648-6ea3-46f0-b301-34bf7b5a5d8a 2023-09-22 23:02:01,250 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(951): ClusterId : 2dafb648-6ea3-46f0-b301-34bf7b5a5d8a 2023-09-22 23:02:01,257 DEBUG [RS:0;jenkins-hbase4:37507] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 23:02:01,257 DEBUG [RS:2;jenkins-hbase4:40697] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 23:02:01,257 DEBUG [RS:1;jenkins-hbase4:38937] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 23:02:01,265 DEBUG [RS:0;jenkins-hbase4:37507] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 23:02:01,265 DEBUG [RS:1;jenkins-hbase4:38937] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 23:02:01,265 DEBUG [RS:2;jenkins-hbase4:40697] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 23:02:01,265 DEBUG [RS:1;jenkins-hbase4:38937] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 23:02:01,265 DEBUG [RS:0;jenkins-hbase4:37507] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 23:02:01,265 DEBUG [RS:2;jenkins-hbase4:40697] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 23:02:01,271 DEBUG [RS:0;jenkins-hbase4:37507] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 23:02:01,271 DEBUG [RS:2;jenkins-hbase4:40697] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 23:02:01,272 DEBUG [RS:1;jenkins-hbase4:38937] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 23:02:01,275 DEBUG [RS:2;jenkins-hbase4:40697] zookeeper.ReadOnlyZKClient(139): Connect 0x415e0276 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:01,275 DEBUG [RS:1;jenkins-hbase4:38937] zookeeper.ReadOnlyZKClient(139): Connect 0x4ac38707 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:01,275 DEBUG [RS:0;jenkins-hbase4:37507] zookeeper.ReadOnlyZKClient(139): Connect 0x0556c14c to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:01,295 DEBUG [RS:1;jenkins-hbase4:38937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4404702f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:01,296 DEBUG [RS:1;jenkins-hbase4:38937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@403bec77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-22 23:02:01,297 DEBUG [RS:2;jenkins-hbase4:40697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f99f42d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:01,297 DEBUG [RS:2;jenkins-hbase4:40697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ba66906, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-22 23:02:01,298 DEBUG [RS:0;jenkins-hbase4:37507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b912f96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:01,299 DEBUG [RS:0;jenkins-hbase4:37507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@faeaa3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-22 23:02:01,324 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37507 2023-09-22 23:02:01,325 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40697 2023-09-22 23:02:01,329 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38937 2023-09-22 23:02:01,330 INFO [RS:2;jenkins-hbase4:40697] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 23:02:01,330 INFO [RS:1;jenkins-hbase4:38937] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 23:02:01,330 INFO [RS:2;jenkins-hbase4:40697] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 23:02:01,330 INFO [RS:0;jenkins-hbase4:37507] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 23:02:01,330 INFO [RS:0;jenkins-hbase4:37507] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 23:02:01,330 INFO [RS:1;jenkins-hbase4:38937] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 23:02:01,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-22 23:02:01,362 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 23:02:01,362 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 23:02:01,362 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 23:02:01,364 INFO [RS:2;jenkins-hbase4:40697] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:01,364 INFO [RS:0;jenkins-hbase4:37507] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:01,365 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 23:02:01,364 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 23:02:01,364 INFO [RS:1;jenkins-hbase4:38937] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:01,365 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 23:02:01,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:01,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-22 23:02:01,367 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46029,1695423718942 with isa=jenkins-hbase4.apache.org/172.31.14.131:38937, startcode=1695423720190 2023-09-22 23:02:01,367 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46029,1695423718942 with isa=jenkins-hbase4.apache.org/172.31.14.131:37507, startcode=1695423720143 2023-09-22 23:02:01,367 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46029,1695423718942 with isa=jenkins-hbase4.apache.org/172.31.14.131:40697, startcode=1695423720223 2023-09-22 23:02:01,387 DEBUG [RS:1;jenkins-hbase4:38937] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 23:02:01,387 DEBUG [RS:0;jenkins-hbase4:37507] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 23:02:01,387 DEBUG [RS:2;jenkins-hbase4:40697] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 23:02:01,492 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37325, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 23:02:01,492 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39275, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 23:02:01,492 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50899, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 23:02:01,501 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46029] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-22 23:02:01,509 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46029] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-22 23:02:01,510 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46029] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-22 23:02:01,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-22 23:02:01,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-22 23:02:01,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-22 23:02:01,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-22 23:02:01,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-22 23:02:01,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-22 23:02:01,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-22 23:02:01,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,530 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(2830): Master is not running yet 2023-09-22 23:02:01,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695423751530 2023-09-22 23:02:01,530 WARN [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-22 23:02:01,530 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(2830): Master is not running yet 2023-09-22 23:02:01,530 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(2830): Master is not running yet 2023-09-22 23:02:01,530 WARN [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-22 23:02:01,530 WARN [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-22 23:02:01,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-22 23:02:01,536 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-22 23:02:01,536 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-22 23:02:01,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-22 23:02:01,542 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 23:02:01,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-22 23:02:01,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-22 23:02:01,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-22 23:02:01,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-22 23:02:01,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-22 23:02:01,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-22 23:02:01,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-22 23:02:01,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-22 23:02:01,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-22 23:02:01,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695423721560,5,FailOnTimeoutGroup] 2023-09-22 23:02:01,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695423721560,5,FailOnTimeoutGroup] 2023-09-22 23:02:01,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-22 23:02:01,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,588 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-22 23:02:01,590 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-22 23:02:01,590 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:01,613 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:01,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-22 23:02:01,618 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/info 2023-09-22 23:02:01,618 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-22 23:02:01,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:01,620 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-22 23:02:01,622 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/rep_barrier 2023-09-22 23:02:01,623 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-22 23:02:01,623 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:01,624 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-22 23:02:01,626 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/table 2023-09-22 23:02:01,626 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-22 23:02:01,627 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:01,629 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740 2023-09-22 23:02:01,630 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740 2023-09-22 23:02:01,631 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46029,1695423718942 with isa=jenkins-hbase4.apache.org/172.31.14.131:37507, startcode=1695423720143 2023-09-22 23:02:01,631 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46029,1695423718942 with isa=jenkins-hbase4.apache.org/172.31.14.131:38937, startcode=1695423720190 2023-09-22 23:02:01,631 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46029,1695423718942 with isa=jenkins-hbase4.apache.org/172.31.14.131:40697, startcode=1695423720223 2023-09-22 23:02:01,635 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-22 23:02:01,637 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46029] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:01,638 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-22 23:02:01,642 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:01,643 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63220352, jitterRate=-0.05794334411621094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-22 23:02:01,643 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-22 23:02:01,643 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46029] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:01,644 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-22 23:02:01,644 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-22 23:02:01,644 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-22 23:02:01,644 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-22 23:02:01,644 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:01,645 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34671 2023-09-22 23:02:01,645 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46029] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:01,645 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-22 23:02:01,645 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:01,645 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 23:02:01,646 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34671 2023-09-22 23:02:01,646 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:01,647 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 23:02:01,647 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34671 2023-09-22 23:02:01,647 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 23:02:01,649 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-22 23:02:01,649 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-22 23:02:01,652 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 23:02:01,655 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-22 23:02:01,655 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-22 23:02:01,663 DEBUG [RS:0;jenkins-hbase4:37507] zookeeper.ZKUtil(162): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:01,664 WARN [RS:0;jenkins-hbase4:37507] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 23:02:01,664 INFO [RS:0;jenkins-hbase4:37507] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 23:02:01,664 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:01,664 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38937,1695423720190] 2023-09-22 23:02:01,664 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40697,1695423720223] 2023-09-22 23:02:01,664 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37507,1695423720143] 2023-09-22 23:02:01,664 DEBUG [RS:1;jenkins-hbase4:38937] zookeeper.ZKUtil(162): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:01,664 WARN [RS:1;jenkins-hbase4:38937] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 23:02:01,665 DEBUG [RS:2;jenkins-hbase4:40697] zookeeper.ZKUtil(162): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:01,665 WARN [RS:2;jenkins-hbase4:40697] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 23:02:01,665 INFO [RS:1;jenkins-hbase4:38937] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 23:02:01,669 INFO [RS:2;jenkins-hbase4:40697] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 23:02:01,670 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:01,670 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:01,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-22 23:02:01,686 DEBUG [RS:1;jenkins-hbase4:38937] zookeeper.ZKUtil(162): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:01,686 DEBUG [RS:2;jenkins-hbase4:40697] zookeeper.ZKUtil(162): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:01,686 DEBUG [RS:0;jenkins-hbase4:37507] zookeeper.ZKUtil(162): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:01,687 DEBUG [RS:1;jenkins-hbase4:38937] zookeeper.ZKUtil(162): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:01,687 DEBUG [RS:2;jenkins-hbase4:40697] zookeeper.ZKUtil(162): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:01,687 DEBUG [RS:0;jenkins-hbase4:37507] zookeeper.ZKUtil(162): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:01,687 DEBUG [RS:2;jenkins-hbase4:40697] zookeeper.ZKUtil(162): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:01,687 DEBUG [RS:1;jenkins-hbase4:38937] zookeeper.ZKUtil(162): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:01,688 DEBUG [RS:0;jenkins-hbase4:37507] zookeeper.ZKUtil(162): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:01,693 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-22 23:02:01,696 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-22 23:02:01,703 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 23:02:01,703 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 23:02:01,703 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 23:02:01,713 INFO [RS:1;jenkins-hbase4:38937] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 23:02:01,714 INFO [RS:2;jenkins-hbase4:40697] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 23:02:01,713 INFO [RS:0;jenkins-hbase4:37507] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 23:02:01,739 INFO [RS:2;jenkins-hbase4:40697] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 23:02:01,739 INFO [RS:0;jenkins-hbase4:37507] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 23:02:01,739 INFO [RS:1;jenkins-hbase4:38937] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 23:02:01,743 INFO [RS:1;jenkins-hbase4:38937] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 23:02:01,743 INFO [RS:1;jenkins-hbase4:38937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,744 INFO [RS:2;jenkins-hbase4:40697] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 23:02:01,744 INFO [RS:0;jenkins-hbase4:37507] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 23:02:01,745 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 23:02:01,745 INFO [RS:2;jenkins-hbase4:40697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,745 INFO [RS:0;jenkins-hbase4:37507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,745 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 23:02:01,746 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 23:02:01,754 INFO [RS:0;jenkins-hbase4:37507] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,754 INFO [RS:2;jenkins-hbase4:40697] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,754 INFO [RS:1;jenkins-hbase4:38937] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,755 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,755 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,755 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,755 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,755 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,755 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-22 23:02:01,756 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-22 23:02:01,756 DEBUG [RS:0;jenkins-hbase4:37507] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,756 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,757 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,757 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,757 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-22 23:02:01,757 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,757 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,757 DEBUG [RS:1;jenkins-hbase4:38937] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,757 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,757 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,757 DEBUG [RS:2;jenkins-hbase4:40697] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 23:02:01,761 INFO [RS:2;jenkins-hbase4:40697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,761 INFO [RS:0;jenkins-hbase4:37507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,761 INFO [RS:2;jenkins-hbase4:40697] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,761 INFO [RS:0;jenkins-hbase4:37507] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,762 INFO [RS:2;jenkins-hbase4:40697] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,761 INFO [RS:1;jenkins-hbase4:38937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,762 INFO [RS:0;jenkins-hbase4:37507] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,762 INFO [RS:1;jenkins-hbase4:38937] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,762 INFO [RS:1;jenkins-hbase4:38937] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,780 INFO [RS:0;jenkins-hbase4:37507] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 23:02:01,780 INFO [RS:1;jenkins-hbase4:38937] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 23:02:01,780 INFO [RS:2;jenkins-hbase4:40697] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 23:02:01,783 INFO [RS:0;jenkins-hbase4:37507] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37507,1695423720143-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,783 INFO [RS:2;jenkins-hbase4:40697] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40697,1695423720223-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,783 INFO [RS:1;jenkins-hbase4:38937] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38937,1695423720190-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:01,808 INFO [RS:1;jenkins-hbase4:38937] regionserver.Replication(203): jenkins-hbase4.apache.org,38937,1695423720190 started 2023-09-22 23:02:01,808 INFO [RS:2;jenkins-hbase4:40697] regionserver.Replication(203): jenkins-hbase4.apache.org,40697,1695423720223 started 2023-09-22 23:02:01,808 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38937,1695423720190, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38937, sessionid=0x100d5e01a070002 2023-09-22 23:02:01,808 INFO [RS:0;jenkins-hbase4:37507] regionserver.Replication(203): jenkins-hbase4.apache.org,37507,1695423720143 started 2023-09-22 23:02:01,808 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40697,1695423720223, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40697, sessionid=0x100d5e01a070003 2023-09-22 23:02:01,809 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37507,1695423720143, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37507, sessionid=0x100d5e01a070001 2023-09-22 23:02:01,809 DEBUG [RS:2;jenkins-hbase4:40697] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 23:02:01,809 DEBUG [RS:0;jenkins-hbase4:37507] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 23:02:01,809 DEBUG [RS:2;jenkins-hbase4:40697] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:01,809 DEBUG [RS:1;jenkins-hbase4:38937] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 23:02:01,810 DEBUG [RS:2;jenkins-hbase4:40697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40697,1695423720223' 2023-09-22 23:02:01,809 DEBUG [RS:0;jenkins-hbase4:37507] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:01,810 DEBUG [RS:2;jenkins-hbase4:40697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 23:02:01,810 DEBUG [RS:1;jenkins-hbase4:38937] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:01,811 DEBUG [RS:1;jenkins-hbase4:38937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38937,1695423720190' 2023-09-22 23:02:01,810 DEBUG [RS:0;jenkins-hbase4:37507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37507,1695423720143' 2023-09-22 23:02:01,811 DEBUG [RS:0;jenkins-hbase4:37507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 23:02:01,811 DEBUG [RS:1;jenkins-hbase4:38937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 23:02:01,811 DEBUG [RS:2;jenkins-hbase4:40697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 23:02:01,811 DEBUG [RS:0;jenkins-hbase4:37507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 23:02:01,812 DEBUG [RS:1;jenkins-hbase4:38937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 23:02:01,812 DEBUG [RS:2;jenkins-hbase4:40697] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 23:02:01,812 DEBUG [RS:2;jenkins-hbase4:40697] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 23:02:01,812 DEBUG [RS:2;jenkins-hbase4:40697] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:01,812 DEBUG [RS:2;jenkins-hbase4:40697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40697,1695423720223' 2023-09-22 23:02:01,812 DEBUG [RS:2;jenkins-hbase4:40697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:01,812 DEBUG [RS:1;jenkins-hbase4:38937] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 23:02:01,812 DEBUG [RS:1;jenkins-hbase4:38937] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 23:02:01,812 DEBUG [RS:0;jenkins-hbase4:37507] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 23:02:01,812 DEBUG [RS:1;jenkins-hbase4:38937] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:01,813 DEBUG [RS:1;jenkins-hbase4:38937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38937,1695423720190' 2023-09-22 23:02:01,813 DEBUG [RS:2;jenkins-hbase4:40697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:01,813 DEBUG [RS:0;jenkins-hbase4:37507] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 23:02:01,813 DEBUG [RS:1;jenkins-hbase4:38937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:01,813 DEBUG [RS:0;jenkins-hbase4:37507] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:01,813 DEBUG [RS:0;jenkins-hbase4:37507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37507,1695423720143' 2023-09-22 23:02:01,813 DEBUG [RS:0;jenkins-hbase4:37507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:01,814 DEBUG [RS:2;jenkins-hbase4:40697] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 23:02:01,814 INFO [RS:2;jenkins-hbase4:40697] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 23:02:01,814 INFO [RS:2;jenkins-hbase4:40697] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 23:02:01,814 DEBUG [RS:0;jenkins-hbase4:37507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:01,814 DEBUG [RS:1;jenkins-hbase4:38937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:01,814 DEBUG [RS:0;jenkins-hbase4:37507] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 23:02:01,815 INFO [RS:0;jenkins-hbase4:37507] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 23:02:01,816 INFO [RS:0;jenkins-hbase4:37507] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 23:02:01,816 DEBUG [RS:1;jenkins-hbase4:38937] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 23:02:01,816 INFO [RS:1;jenkins-hbase4:38937] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 23:02:01,816 INFO [RS:1;jenkins-hbase4:38937] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 23:02:01,848 DEBUG [jenkins-hbase4:46029] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-22 23:02:01,852 DEBUG [jenkins-hbase4:46029] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:02:01,858 DEBUG [jenkins-hbase4:46029] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:02:01,858 DEBUG [jenkins-hbase4:46029] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:02:01,858 DEBUG [jenkins-hbase4:46029] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:02:01,859 DEBUG [jenkins-hbase4:46029] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:02:01,862 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38937,1695423720190, state=OPENING 2023-09-22 23:02:01,869 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-22 23:02:01,871 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:01,871 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-22 23:02:01,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:02:01,925 INFO [RS:0;jenkins-hbase4:37507] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37507%2C1695423720143, suffix=, logDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,37507,1695423720143, archiveDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/oldWALs, maxLogs=32 2023-09-22 23:02:01,925 INFO [RS:1;jenkins-hbase4:38937] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38937%2C1695423720190, suffix=, logDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,38937,1695423720190, archiveDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/oldWALs, maxLogs=32 2023-09-22 23:02:01,925 INFO [RS:2;jenkins-hbase4:40697] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40697%2C1695423720223, suffix=, logDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,40697,1695423720223, archiveDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/oldWALs, maxLogs=32 2023-09-22 23:02:01,950 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK] 2023-09-22 23:02:01,950 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK] 2023-09-22 23:02:01,950 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK] 2023-09-22 23:02:01,967 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK] 2023-09-22 23:02:01,967 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK] 2023-09-22 23:02:01,967 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK] 2023-09-22 23:02:01,968 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK] 2023-09-22 23:02:01,968 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK] 2023-09-22 23:02:01,969 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK] 2023-09-22 23:02:01,975 INFO [RS:1;jenkins-hbase4:38937] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,38937,1695423720190/jenkins-hbase4.apache.org%2C38937%2C1695423720190.1695423721929 2023-09-22 23:02:01,977 DEBUG [RS:1;jenkins-hbase4:38937] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK], DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK], DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK]] 2023-09-22 23:02:01,979 INFO [RS:2;jenkins-hbase4:40697] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,40697,1695423720223/jenkins-hbase4.apache.org%2C40697%2C1695423720223.1695423721929 2023-09-22 23:02:01,985 DEBUG [RS:2;jenkins-hbase4:40697] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK], DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK], DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK]] 2023-09-22 23:02:01,986 INFO [RS:0;jenkins-hbase4:37507] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,37507,1695423720143/jenkins-hbase4.apache.org%2C37507%2C1695423720143.1695423721929 2023-09-22 23:02:01,986 DEBUG [RS:0;jenkins-hbase4:37507] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK], DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK], DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK]] 2023-09-22 23:02:02,064 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:02,067 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 23:02:02,070 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 23:02:02,086 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-22 23:02:02,086 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 23:02:02,090 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38937%2C1695423720190.meta, suffix=.meta, logDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,38937,1695423720190, archiveDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/oldWALs, maxLogs=32 2023-09-22 23:02:02,110 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK] 2023-09-22 23:02:02,111 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK] 2023-09-22 23:02:02,112 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK] 2023-09-22 23:02:02,120 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/WALs/jenkins-hbase4.apache.org,38937,1695423720190/jenkins-hbase4.apache.org%2C38937%2C1695423720190.meta.1695423722091.meta 2023-09-22 23:02:02,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33393,DS-303ff3ba-52c2-48c9-99f7-0a9863f599d8,DISK], DatanodeInfoWithStorage[127.0.0.1:41165,DS-2328105b-5540-4f5b-a79e-cef7bb2a611c,DISK], DatanodeInfoWithStorage[127.0.0.1:45745,DS-8b5fccb7-0434-4f5d-bf4e-bcbc3804051e,DISK]] 2023-09-22 23:02:02,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-22 23:02:02,122 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-22 23:02:02,124 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:02,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-22 23:02:02,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-22 23:02:02,130 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-22 23:02:02,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-22 23:02:02,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:02,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-22 23:02:02,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-22 23:02:02,149 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-22 23:02:02,151 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/info 2023-09-22 23:02:02,151 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/info 2023-09-22 23:02:02,151 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-22 23:02:02,153 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:02,153 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-22 23:02:02,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/rep_barrier 2023-09-22 23:02:02,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/rep_barrier 2023-09-22 23:02:02,156 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-22 23:02:02,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:02,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-22 23:02:02,159 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/table 2023-09-22 23:02:02,159 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/table 2023-09-22 23:02:02,159 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-22 23:02:02,160 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:02,163 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740 2023-09-22 23:02:02,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740 2023-09-22 23:02:02,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-22 23:02:02,172 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-22 23:02:02,174 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74912231, jitterRate=0.1162792295217514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-22 23:02:02,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-22 23:02:02,189 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695423722056 2023-09-22 23:02:02,210 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-22 23:02:02,211 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-22 23:02:02,211 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38937,1695423720190, state=OPEN 2023-09-22 23:02:02,214 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-22 23:02:02,215 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-22 23:02:02,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-22 23:02:02,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38937,1695423720190 in 340 msec 2023-09-22 23:02:02,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-22 23:02:02,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 551 msec 2023-09-22 23:02:02,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 854 msec 2023-09-22 23:02:02,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695423722230, completionTime=-1 2023-09-22 23:02:02,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-22 23:02:02,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-22 23:02:02,303 DEBUG [hconnection-0x15efe84-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:02,306 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:02,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-22 23:02:02,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695423782336 2023-09-22 23:02:02,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695423842337 2023-09-22 23:02:02,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 105 msec 2023-09-22 23:02:02,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46029,1695423718942-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:02,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46029,1695423718942-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:02,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46029,1695423718942-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:02,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46029, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:02,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-22 23:02:02,376 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-22 23:02:02,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-22 23:02:02,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 23:02:02,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-22 23:02:02,403 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:02:02,406 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:02:02,467 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/hbase/namespace/756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,470 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/hbase/namespace/756f00818605581423c8a972bdd5ce72 empty. 2023-09-22 23:02:02,470 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/hbase/namespace/756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,471 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-22 23:02:02,505 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-22 23:02:02,508 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 756f00818605581423c8a972bdd5ce72, NAME => 'hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:02:02,526 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:02,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 756f00818605581423c8a972bdd5ce72, disabling compactions & flushes 2023-09-22 23:02:02,527 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:02:02,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:02:02,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. after waiting 0 ms 2023-09-22 23:02:02,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:02:02,527 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:02:02,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 756f00818605581423c8a972bdd5ce72: 2023-09-22 23:02:02,532 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:02:02,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695423722534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423722534"}]},"ts":"1695423722534"} 2023-09-22 23:02:02,574 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-22 23:02:02,576 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:02:02,580 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423722576"}]},"ts":"1695423722576"} 2023-09-22 23:02:02,584 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-22 23:02:02,588 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:02:02,589 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:02:02,589 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:02:02,589 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:02:02,589 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:02:02,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=756f00818605581423c8a972bdd5ce72, ASSIGN}] 2023-09-22 23:02:02,594 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=756f00818605581423c8a972bdd5ce72, ASSIGN 2023-09-22 23:02:02,596 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=756f00818605581423c8a972bdd5ce72, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37507,1695423720143; forceNewPlan=false, retain=false 2023-09-22 23:02:02,749 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 23:02:02,750 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=756f00818605581423c8a972bdd5ce72, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:02,751 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695423722750"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423722750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423722750"}]},"ts":"1695423722750"} 2023-09-22 23:02:02,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 756f00818605581423c8a972bdd5ce72, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:02:02,911 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:02,912 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 23:02:02,915 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 23:02:02,921 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:02:02,921 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 756f00818605581423c8a972bdd5ce72, NAME => 'hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72.', STARTKEY => '', ENDKEY => ''} 2023-09-22 23:02:02,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. service=AccessControlService 2023-09-22 23:02:02,922 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:02,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:02,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,925 INFO [StoreOpener-756f00818605581423c8a972bdd5ce72-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,927 DEBUG [StoreOpener-756f00818605581423c8a972bdd5ce72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72/info 2023-09-22 23:02:02,928 DEBUG [StoreOpener-756f00818605581423c8a972bdd5ce72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72/info 2023-09-22 23:02:02,928 INFO [StoreOpener-756f00818605581423c8a972bdd5ce72-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 756f00818605581423c8a972bdd5ce72 columnFamilyName info 2023-09-22 23:02:02,929 INFO [StoreOpener-756f00818605581423c8a972bdd5ce72-1] regionserver.HStore(310): Store=756f00818605581423c8a972bdd5ce72/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:02,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 756f00818605581423c8a972bdd5ce72 2023-09-22 23:02:02,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:02,940 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 756f00818605581423c8a972bdd5ce72; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61941077, jitterRate=-0.0770060271024704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:02,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 756f00818605581423c8a972bdd5ce72: 2023-09-22 23:02:02,942 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72., pid=6, masterSystemTime=1695423722911 2023-09-22 23:02:02,946 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:02:02,947 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:02:02,949 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=756f00818605581423c8a972bdd5ce72, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:02,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695423722948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423722948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423722948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423722948"}]},"ts":"1695423722948"} 2023-09-22 23:02:02,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-22 23:02:02,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 756f00818605581423c8a972bdd5ce72, server=jenkins-hbase4.apache.org,37507,1695423720143 in 195 msec 2023-09-22 23:02:02,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-22 23:02:02,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=756f00818605581423c8a972bdd5ce72, ASSIGN in 364 msec 2023-09-22 23:02:02,962 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:02:02,963 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423722962"}]},"ts":"1695423722962"} 2023-09-22 23:02:02,965 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-22 23:02:02,969 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:02:02,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 578 msec 2023-09-22 23:02:03,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-22 23:02:03,005 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-22 23:02:03,005 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:03,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:03,035 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:03,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-22 23:02:03,069 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-22 23:02:03,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-09-22 23:02:03,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-22 23:02:03,096 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-22 23:02:03,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-22 23:02:03,110 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-22 23:02:03,113 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-22 23:02:03,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.816sec 2023-09-22 23:02:03,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-22 23:02:03,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-22 23:02:03,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-22 23:02:03,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46029,1695423718942-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-22 23:02:03,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46029,1695423718942-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-22 23:02:03,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 23:02:03,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-22 23:02:03,144 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:02:03,145 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:02:03,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-22 23:02:03,148 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,149 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9 empty. 2023-09-22 23:02:03,151 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,151 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-22 23:02:03,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 23:02:03,159 DEBUG [Listener at localhost/35385] zookeeper.ReadOnlyZKClient(139): Connect 0x6bf08614 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:03,164 DEBUG [Listener at localhost/35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52492d35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:03,183 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-22 23:02:03,186 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5a4bb34f0a816115bc31f674d1d009b9, NAME => 'hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:02:03,187 DEBUG [hconnection-0x5f69858d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:03,203 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/test.cache.data in system properties and HBase conf 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop.tmp.dir in system properties and HBase conf 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop.log.dir in system properties and HBase conf 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-22 23:02:03,213 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/nfs.dump.dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-22 23:02:03,214 INFO [Listener at localhost/35385] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-22 23:02:03,219 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:03,219 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 5a4bb34f0a816115bc31f674d1d009b9, disabling compactions & flushes 2023-09-22 23:02:03,219 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:02:03,219 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:02:03,219 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. after waiting 0 ms 2023-09-22 23:02:03,219 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:02:03,219 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:02:03,219 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 5a4bb34f0a816115bc31f674d1d009b9: 2023-09-22 23:02:03,224 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:02:03,225 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695423723225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423723225"}]},"ts":"1695423723225"} 2023-09-22 23:02:03,228 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-22 23:02:03,229 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:02:03,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423723229"}]},"ts":"1695423723229"} 2023-09-22 23:02:03,231 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-22 23:02:03,237 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:02:03,238 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:02:03,238 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:02:03,238 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:02:03,238 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:02:03,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5a4bb34f0a816115bc31f674d1d009b9, ASSIGN}] 2023-09-22 23:02:03,240 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5a4bb34f0a816115bc31f674d1d009b9, ASSIGN 2023-09-22 23:02:03,242 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=5a4bb34f0a816115bc31f674d1d009b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40697,1695423720223; forceNewPlan=false, retain=false 2023-09-22 23:02:03,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 23:02:03,392 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 23:02:03,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5a4bb34f0a816115bc31f674d1d009b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:03,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695423723393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423723393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423723393"}]},"ts":"1695423723393"} 2023-09-22 23:02:03,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5a4bb34f0a816115bc31f674d1d009b9, server=jenkins-hbase4.apache.org,40697,1695423720223}] 2023-09-22 23:02:03,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 23:02:03,551 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:03,551 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 23:02:03,553 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 23:02:03,560 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:02:03,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a4bb34f0a816115bc31f674d1d009b9, NAME => 'hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9.', STARTKEY => '', ENDKEY => ''} 2023-09-22 23:02:03,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. service=AccessControlService 2023-09-22 23:02:03,561 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:03,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:03,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,563 INFO [StoreOpener-5a4bb34f0a816115bc31f674d1d009b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,565 DEBUG [StoreOpener-5a4bb34f0a816115bc31f674d1d009b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9/l 2023-09-22 23:02:03,566 DEBUG [StoreOpener-5a4bb34f0a816115bc31f674d1d009b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9/l 2023-09-22 23:02:03,566 INFO [StoreOpener-5a4bb34f0a816115bc31f674d1d009b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a4bb34f0a816115bc31f674d1d009b9 columnFamilyName l 2023-09-22 23:02:03,567 INFO [StoreOpener-5a4bb34f0a816115bc31f674d1d009b9-1] regionserver.HStore(310): Store=5a4bb34f0a816115bc31f674d1d009b9/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:03,569 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:02:03,578 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:03,579 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5a4bb34f0a816115bc31f674d1d009b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60044431, jitterRate=-0.10526825487613678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:03,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5a4bb34f0a816115bc31f674d1d009b9: 2023-09-22 23:02:03,581 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9., pid=11, masterSystemTime=1695423723551 2023-09-22 23:02:03,585 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:02:03,586 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:02:03,587 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5a4bb34f0a816115bc31f674d1d009b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:03,587 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695423723586"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423723586"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423723586"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423723586"}]},"ts":"1695423723586"} 2023-09-22 23:02:03,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-22 23:02:03,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5a4bb34f0a816115bc31f674d1d009b9, server=jenkins-hbase4.apache.org,40697,1695423720223 in 194 msec 2023-09-22 23:02:03,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-22 23:02:03,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=5a4bb34f0a816115bc31f674d1d009b9, ASSIGN in 356 msec 2023-09-22 23:02:03,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:02:03,600 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423723600"}]},"ts":"1695423723600"} 2023-09-22 23:02:03,605 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-22 23:02:03,608 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:02:03,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 468 msec 2023-09-22 23:02:03,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 23:02:03,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-22 23:02:03,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-22 23:02:04,354 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 23:02:04,722 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 23:02:04,729 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43609_jobhistory____7gnw21/webapp 2023-09-22 23:02:04,893 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-22 23:02:04,893 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-22 23:02:04,893 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 23:02:04,897 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 23:02:04,981 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:05,294 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:05,627 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-22 23:02:05,666 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43609 2023-09-22 23:02:05,849 WARN [Listener at jenkins-hbase4.apache.org/45583] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 23:02:06,111 WARN [Listener at jenkins-hbase4.apache.org/45583] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 23:02:06,112 INFO [Listener at jenkins-hbase4.apache.org/45583] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 23:02:06,119 INFO [Listener at jenkins-hbase4.apache.org/45583] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36871_cluster____q5r88l/webapp 2023-09-22 23:02:06,188 INFO [Listener at jenkins-hbase4.apache.org/45583] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 23:02:06,189 INFO [Listener at jenkins-hbase4.apache.org/45583] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-22 23:02:06,189 INFO [Listener at jenkins-hbase4.apache.org/45583] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 23:02:06,189 INFO [Listener at jenkins-hbase4.apache.org/45583] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 23:02:06,197 INFO [Listener at jenkins-hbase4.apache.org/45583] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:06,360 INFO [Listener at jenkins-hbase4.apache.org/45583] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:06,440 INFO [Listener at jenkins-hbase4.apache.org/45583] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:06,447 INFO [Listener at jenkins-hbase4.apache.org/45583] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36871 2023-09-22 23:02:06,931 WARN [Listener at jenkins-hbase4.apache.org/41419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 23:02:06,955 WARN [Listener at jenkins-hbase4.apache.org/41419] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 23:02:06,955 INFO [Listener at jenkins-hbase4.apache.org/41419] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 23:02:06,962 INFO [Listener at jenkins-hbase4.apache.org/41419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40045_node____qg569f/webapp 2023-09-22 23:02:07,013 INFO [Listener at jenkins-hbase4.apache.org/41419] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-22 23:02:07,014 INFO [Listener at jenkins-hbase4.apache.org/41419] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 23:02:07,014 INFO [Listener at jenkins-hbase4.apache.org/41419] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 23:02:07,014 INFO [Listener at jenkins-hbase4.apache.org/41419] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 23:02:07,022 INFO [Listener at jenkins-hbase4.apache.org/41419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:07,041 INFO [Listener at jenkins-hbase4.apache.org/41419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:07,107 INFO [Listener at jenkins-hbase4.apache.org/41419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:07,117 INFO [Listener at jenkins-hbase4.apache.org/41419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40045 2023-09-22 23:02:07,332 WARN [Listener at jenkins-hbase4.apache.org/32797] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 23:02:07,339 WARN [Listener at jenkins-hbase4.apache.org/32797] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 23:02:07,339 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 23:02:07,349 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38777_node____.g38rg0/webapp 2023-09-22 23:02:07,410 INFO [Listener at jenkins-hbase4.apache.org/32797] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-22 23:02:07,410 INFO [Listener at jenkins-hbase4.apache.org/32797] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 23:02:07,411 INFO [Listener at jenkins-hbase4.apache.org/32797] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 23:02:07,411 INFO [Listener at jenkins-hbase4.apache.org/32797] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 23:02:07,418 INFO [Listener at jenkins-hbase4.apache.org/32797] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:07,432 INFO [Listener at jenkins-hbase4.apache.org/32797] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:07,495 INFO [Listener at jenkins-hbase4.apache.org/32797] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 23:02:07,501 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38777 2023-09-22 23:02:07,523 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-22 23:02:07,525 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:02:07,594 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=131, ProcessCount=165, AvailableMemoryMB=2415 2023-09-22 23:02:07,594 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-09-22 23:02:07,608 DEBUG [Listener at jenkins-hbase4.apache.org/32797] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-22 23:02:07,614 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-22 23:02:07,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 23:02:07,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-22 23:02:07,627 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:02:07,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-22 23:02:07,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 23:02:07,630 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:02:07,635 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:07,635 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:07,636 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece empty. 2023-09-22 23:02:07,636 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09 empty. 2023-09-22 23:02:07,637 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:07,637 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:07,637 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-22 23:02:07,672 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-22 23:02:07,674 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8b8112ed79bea35e9d27a7f24e51cece, NAME => 'testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:02:07,674 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => d0ab842b57abfab5c8cc8d3f7628ac09, NAME => 'testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:02:07,706 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 23:02:07,707 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:07,708 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 8b8112ed79bea35e9d27a7f24e51cece, disabling compactions & flushes 2023-09-22 23:02:07,708 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:07,708 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:07,708 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. after waiting 0 ms 2023-09-22 23:02:07,708 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:07,709 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:07,709 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 8b8112ed79bea35e9d27a7f24e51cece: 2023-09-22 23:02:07,714 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:07,714 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing d0ab842b57abfab5c8cc8d3f7628ac09, disabling compactions & flushes 2023-09-22 23:02:07,714 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:07,715 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:07,715 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. after waiting 0 ms 2023-09-22 23:02:07,715 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:07,715 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:07,715 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for d0ab842b57abfab5c8cc8d3f7628ac09: 2023-09-22 23:02:07,721 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:02:07,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423727722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423727722"}]},"ts":"1695423727722"} 2023-09-22 23:02:07,724 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423727722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423727722"}]},"ts":"1695423727722"} 2023-09-22 23:02:07,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 23:02:07,814 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 23:02:07,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:02:07,816 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423727816"}]},"ts":"1695423727816"} 2023-09-22 23:02:07,824 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-22 23:02:07,830 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:02:07,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:02:07,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:02:07,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:02:07,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:02:07,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8b8112ed79bea35e9d27a7f24e51cece, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0ab842b57abfab5c8cc8d3f7628ac09, ASSIGN}] 2023-09-22 23:02:07,837 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0ab842b57abfab5c8cc8d3f7628ac09, ASSIGN 2023-09-22 23:02:07,837 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8b8112ed79bea35e9d27a7f24e51cece, ASSIGN 2023-09-22 23:02:07,838 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0ab842b57abfab5c8cc8d3f7628ac09, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40697,1695423720223; forceNewPlan=false, retain=false 2023-09-22 23:02:07,839 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8b8112ed79bea35e9d27a7f24e51cece, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38937,1695423720190; forceNewPlan=false, retain=false 2023-09-22 23:02:07,864 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-22 23:02:07,866 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-22 23:02:07,868 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-22 23:02:07,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 23:02:07,989 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 23:02:07,991 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8b8112ed79bea35e9d27a7f24e51cece, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:07,991 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d0ab842b57abfab5c8cc8d3f7628ac09, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:07,992 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423727991"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423727991"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423727991"}]},"ts":"1695423727991"} 2023-09-22 23:02:07,992 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423727991"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423727991"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423727991"}]},"ts":"1695423727991"} 2023-09-22 23:02:07,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 8b8112ed79bea35e9d27a7f24e51cece, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:02:07,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure d0ab842b57abfab5c8cc8d3f7628ac09, server=jenkins-hbase4.apache.org,40697,1695423720223}] 2023-09-22 23:02:08,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:08,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b8112ed79bea35e9d27a7f24e51cece, NAME => 'testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 23:02:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0ab842b57abfab5c8cc8d3f7628ac09, NAME => 'testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 23:02:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. service=AccessControlService 2023-09-22 23:02:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. service=AccessControlService 2023-09-22 23:02:08,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:08,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:08,166 INFO [StoreOpener-d0ab842b57abfab5c8cc8d3f7628ac09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:08,166 INFO [StoreOpener-8b8112ed79bea35e9d27a7f24e51cece-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:08,168 DEBUG [StoreOpener-d0ab842b57abfab5c8cc8d3f7628ac09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf 2023-09-22 23:02:08,168 DEBUG [StoreOpener-d0ab842b57abfab5c8cc8d3f7628ac09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf 2023-09-22 23:02:08,168 DEBUG [StoreOpener-8b8112ed79bea35e9d27a7f24e51cece-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf 2023-09-22 23:02:08,168 DEBUG [StoreOpener-8b8112ed79bea35e9d27a7f24e51cece-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf 2023-09-22 23:02:08,172 INFO [StoreOpener-8b8112ed79bea35e9d27a7f24e51cece-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b8112ed79bea35e9d27a7f24e51cece columnFamilyName cf 2023-09-22 23:02:08,172 INFO [StoreOpener-d0ab842b57abfab5c8cc8d3f7628ac09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0ab842b57abfab5c8cc8d3f7628ac09 columnFamilyName cf 2023-09-22 23:02:08,175 INFO [StoreOpener-d0ab842b57abfab5c8cc8d3f7628ac09-1] regionserver.HStore(310): Store=d0ab842b57abfab5c8cc8d3f7628ac09/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:08,175 INFO [StoreOpener-8b8112ed79bea35e9d27a7f24e51cece-1] regionserver.HStore(310): Store=8b8112ed79bea35e9d27a7f24e51cece/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:08,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:08,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:08,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:08,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:08,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:08,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:08,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:08,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0ab842b57abfab5c8cc8d3f7628ac09; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61562867, jitterRate=-0.08264179527759552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:08,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:08,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0ab842b57abfab5c8cc8d3f7628ac09: 2023-09-22 23:02:08,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b8112ed79bea35e9d27a7f24e51cece; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65087440, jitterRate=-0.030121564865112305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:08,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b8112ed79bea35e9d27a7f24e51cece: 2023-09-22 23:02:08,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09., pid=16, masterSystemTime=1695423728148 2023-09-22 23:02:08,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece., pid=15, masterSystemTime=1695423728147 2023-09-22 23:02:08,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:08,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:08,204 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d0ab842b57abfab5c8cc8d3f7628ac09, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:08,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:08,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:08,204 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423728204"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423728204"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423728204"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423728204"}]},"ts":"1695423728204"} 2023-09-22 23:02:08,205 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8b8112ed79bea35e9d27a7f24e51cece, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:08,206 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423728205"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423728205"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423728205"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423728205"}]},"ts":"1695423728205"} 2023-09-22 23:02:08,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-22 23:02:08,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure d0ab842b57abfab5c8cc8d3f7628ac09, server=jenkins-hbase4.apache.org,40697,1695423720223 in 212 msec 2023-09-22 23:02:08,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-22 23:02:08,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 8b8112ed79bea35e9d27a7f24e51cece, server=jenkins-hbase4.apache.org,38937,1695423720190 in 215 msec 2023-09-22 23:02:08,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0ab842b57abfab5c8cc8d3f7628ac09, ASSIGN in 379 msec 2023-09-22 23:02:08,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-22 23:02:08,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8b8112ed79bea35e9d27a7f24e51cece, ASSIGN in 381 msec 2023-09-22 23:02:08,219 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:02:08,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423728219"}]},"ts":"1695423728219"} 2023-09-22 23:02:08,221 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-22 23:02:08,224 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:02:08,229 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-22 23:02:08,235 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:08,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 23:02:08,238 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:08,243 DEBUG [hconnection-0x231ab709-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:08,245 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-22 23:02:08,253 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 23:02:08,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:08,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:08,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:08,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:08,287 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:02:08,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:08,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:08,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:08,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:08,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 672 msec 2023-09-22 23:02:08,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 23:02:08,737 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-22 23:02:08,742 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-22 23:02:08,743 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:08,745 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:02:08,770 DEBUG [hconnection-0x5f69858d-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:08,776 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:08,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 23:02:08,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423728789 (current time:1695423728789). 2023-09-22 23:02:08,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:02:08,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x63aef3c0 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:08,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a18efa9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:08,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:08,802 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:08,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63aef3c0 to 127.0.0.1:57942 2023-09-22 23:02:08,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:08,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x0eb4ee88 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:08,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21bbfd30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:08,813 DEBUG [hconnection-0x31fa4d53-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:08,814 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:08,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:08,821 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:08,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eb4ee88 to 127.0.0.1:57942 2023-09-22 23:02:08,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:08,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 23:02:08,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:02:08,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 23:02:08,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 23:02:08,878 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 23:02:08,879 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695424328879 2023-09-22 23:02:08,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 23:02:08,880 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-22 23:02:08,883 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 23:02:08,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 23:02:08,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-09-22 23:02:08,886 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 23:02:08,887 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695424328887 2023-09-22 23:02:08,889 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:02:08,889 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:02:08,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,917 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-22 23:02:08,918 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:08,918 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-22 23:02:08,918 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-22 23:02:08,919 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,919 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,924 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:08,924 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:08,924 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:08,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:08,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:08,924 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:08,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:08,925 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:08,925 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,926 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:08,926 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:02:08,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 23:02:08,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 23:02:08,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 23:02:08,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,928 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 23:02:08,928 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 23:02:08,928 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 23:02:08,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,931 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 23:02:08,931 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 23:02:08,931 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 23:02:08,931 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:08,931 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:08,931 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:08,933 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 23:02:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 23:02:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 23:02:08,932 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 23:02:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 23:02:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 23:02:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 23:02:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 23:02:08,935 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 23:02:08,938 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:08,938 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,938 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:08,938 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:08,940 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,940 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:08,940 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:08,940 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,940 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:08,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:08,940 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,940 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:08,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:08,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:08,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:08,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:08,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-22 23:02:08,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ccea390[Count = 1] remaining members to acquire global barrier 2023-09-22 23:02:08,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:08,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:08,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:08,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:08,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:08,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:08,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:08,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:08,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:08,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-22 23:02:08,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ccea390[Count = 0] remaining members to acquire global barrier 2023-09-22 23:02:08,946 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-22 23:02:08,946 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,948 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,948 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,949 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 23:02:08,949 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 23:02:08,949 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:08,949 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:08,949 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:02:08,951 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:08,952 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:08,952 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,952 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:08,952 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:08,952 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:08,952 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:08,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,952 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 23:02:08,952 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 23:02:08,952 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:02:08,952 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. started... 2023-09-22 23:02:08,952 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. started... 2023-09-22 23:02:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 23:02:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 23:02:08,957 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0ab842b57abfab5c8cc8d3f7628ac09: 2023-09-22 23:02:08,957 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8b8112ed79bea35e9d27a7f24e51cece: 2023-09-22 23:02:08,958 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,958 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:08,963 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:08,963 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:08,967 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:02:08,967 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:02:08,993 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:09,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 23:02:09,012 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. completed. 2023-09-22 23:02:09,013 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:09,013 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:09,013 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:09,013 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,013 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. completed. 2023-09-22 23:02:09,013 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 23:02:09,014 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:09,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:02:09,014 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:09,014 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:09,014 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,014 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:02:09,014 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 23:02:09,014 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:02:09,014 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:02:09,016 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 23:02:09,016 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,016 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 23:02:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,016 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:09,016 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,016 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:09,016 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 23:02:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:09,017 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 23:02:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:02:09,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-22 23:02:09,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:09,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:09,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40697,1695423720223': 2023-09-22 23:02:09,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-22 23:02:09,026 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-22 23:02:09,026 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:02:09,027 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:02:09,027 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,027 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:02:09,030 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,030 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:09,030 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,030 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,030 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,031 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,031 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:09,031 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,032 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,032 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:09,034 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,035 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,035 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,049 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,049 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,049 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,050 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,050 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,050 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,050 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,050 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,050 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-22 23:02:09,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,050 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,050 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:09,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:02:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,050 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,051 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,051 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,051 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,051 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,052 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,052 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 23:02:09,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,100 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:02:09,101 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-22 23:02:09,101 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:02:09,101 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-22 23:02:09,102 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-22 23:02:09,102 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-22 23:02:09,102 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:02:09,102 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-22 23:02:09,102 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-22 23:02:09,102 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-22 23:02:09,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-22 23:02:09,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,123 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:09,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695423728880Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695423729070 (+190 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695423729070Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695423729070Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695423729084 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695423729109 (+25 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695423729122 (+13 ms) 2023-09-22 23:02:09,125 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 23:02:09,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 243 msec 2023-09-22 23:02:09,214 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:09,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 23:02:09,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:02:09,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38937] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:02:09,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40697] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:02:09,241 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-22 23:02:09,241 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:09,242 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:02:09,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 23:02:09,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423729257 (current time:1695423729257). 2023-09-22 23:02:09,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:02:09,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x74ccdcca to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:09,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dde2d35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:09,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:09,269 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:09,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74ccdcca to 127.0.0.1:57942 2023-09-22 23:02:09,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:09,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x58236021 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:09,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a1bdd63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:09,279 DEBUG [hconnection-0x36d0f690-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:09,281 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:09,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:09,287 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:09,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58236021 to 127.0.0.1:57942 2023-09-22 23:02:09,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:09,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 23:02:09,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:02:09,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 23:02:09,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 23:02:09,293 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 23:02:09,294 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695424329294 2023-09-22 23:02:09,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 23:02:09,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-22 23:02:09,296 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:02:09,296 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:02:09,297 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 23:02:09,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 23:02:09,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-22 23:02:09,299 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 23:02:09,300 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695424329300 2023-09-22 23:02:09,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-22 23:02:09,323 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-22 23:02:09,323 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:09,324 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-22 23:02:09,324 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-22 23:02:09,324 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,325 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,326 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,327 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,327 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,327 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,328 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:02:09,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 23:02:09,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 23:02:09,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 23:02:09,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 23:02:09,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 23:02:09,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 23:02:09,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 23:02:09,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 23:02:09,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 23:02:09,329 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 23:02:09,329 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 23:02:09,329 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:09,329 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 23:02:09,330 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 23:02:09,330 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 23:02:09,330 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 23:02:09,330 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:09,329 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:09,331 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 23:02:09,332 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 23:02:09,332 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 23:02:09,332 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 23:02:09,332 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 23:02:09,332 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 23:02:09,334 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,334 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:09,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:09,336 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,337 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,337 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:09,337 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,337 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,337 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:09,337 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:09,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:09,337 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,337 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:09,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:09,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-22 23:02:09,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eda100c[Count = 1] remaining members to acquire global barrier 2023-09-22 23:02:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:09,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:09,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-22 23:02:09,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eda100c[Count = 0] remaining members to acquire global barrier 2023-09-22 23:02:09,343 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-22 23:02:09,343 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 23:02:09,348 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 23:02:09,348 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:02:09,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,348 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 23:02:09,348 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 23:02:09,349 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,349 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:02:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:09,349 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:09,349 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:09,349 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. started... 2023-09-22 23:02:09,349 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. started... 2023-09-22 23:02:09,349 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8b8112ed79bea35e9d27a7f24e51cece 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-22 23:02:09,349 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d0ab842b57abfab5c8cc8d3f7628ac09 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-22 23:02:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 23:02:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 23:02:09,396 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:09,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 23:02:09,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:02:09,398 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:02:09,494 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922d2d67c08597f44588862ba3fdb1dcf62 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230922d2d67c08597f44588862ba3fdb1dcf62 2023-09-22 23:02:09,494 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922a9d03651adb041b9aaf0457e1b3cdeda to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9d03651adb041b9aaf0457e1b3cdeda 2023-09-22 23:02:09,525 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/.tmp/cf/acd054732b5644eaa896c438ba7994f4 2023-09-22 23:02:09,525 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/.tmp/cf/23a83c58269d46659076e00893029dd1 2023-09-22 23:02:09,536 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/.tmp/cf/23a83c58269d46659076e00893029dd1 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf/23a83c58269d46659076e00893029dd1 2023-09-22 23:02:09,539 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/.tmp/cf/acd054732b5644eaa896c438ba7994f4 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf/acd054732b5644eaa896c438ba7994f4 2023-09-22 23:02:09,545 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf/23a83c58269d46659076e00893029dd1, entries=2, sequenceid=6, filesize=5.2 K 2023-09-22 23:02:09,548 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf/acd054732b5644eaa896c438ba7994f4, entries=48, sequenceid=6, filesize=13.0 K 2023-09-22 23:02:09,549 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 8b8112ed79bea35e9d27a7f24e51cece in 200ms, sequenceid=6, compaction requested=false 2023-09-22 23:02:09,550 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-22 23:02:09,551 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8b8112ed79bea35e9d27a7f24e51cece: 2023-09-22 23:02:09,551 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d0ab842b57abfab5c8cc8d3f7628ac09 in 202ms, sequenceid=6, compaction requested=false 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0ab842b57abfab5c8cc8d3f7628ac09: 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf/23a83c58269d46659076e00893029dd1] hfiles 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf/acd054732b5644eaa896c438ba7994f4] hfiles 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf/23a83c58269d46659076e00893029dd1 for snapshot=snaptb0-testExportWithTargetName 2023-09-22 23:02:09,552 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf/acd054732b5644eaa896c438ba7994f4 for snapshot=snaptb0-testExportWithTargetName 2023-09-22 23:02:09,577 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. completed. 2023-09-22 23:02:09,577 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:09,577 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:09,577 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:09,577 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,577 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 23:02:09,578 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:02:09,578 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. completed. 2023-09-22 23:02:09,578 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:09,578 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:09,579 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:09,579 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,579 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 23:02:09,579 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:02:09,580 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,580 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 23:02:09,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:09,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:09,580 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:09,580 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 23:02:09,582 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,582 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 23:02:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:09,582 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:09,582 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 23:02:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:09,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40697,1695423720223': 2023-09-22 23:02:09,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-22 23:02:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:02:09,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-22 23:02:09,591 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-22 23:02:09,591 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:02:09,592 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:02:09,592 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-22 23:02:09,592 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:02:09,594 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,594 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:09,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,595 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,594 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:09,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,595 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,596 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,598 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,598 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:09,599 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 23:02:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 23:02:09,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:02:09,599 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,600 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-22 23:02:09,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:09,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:09,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:09,613 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-22 23:02:09,613 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:09,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-22 23:02:09,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:09,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,614 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:09,615 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,615 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:09,615 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:09,615 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,615 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:09,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 23:02:09,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:02:09,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9d03651adb041b9aaf0457e1b3cdeda, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230922d2d67c08597f44588862ba3fdb1dcf62] mob files 2023-09-22 23:02:09,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9d03651adb041b9aaf0457e1b3cdeda 2023-09-22 23:02:09,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230922d2d67c08597f44588862ba3fdb1dcf62 2023-09-22 23:02:09,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-22 23:02:09,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 23:02:09,900 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:09,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 23:02:09,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:02:09,904 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-22 23:02:10,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-22 23:02:10,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-22 23:02:10,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 23:02:10,079 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 23:02:10,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695423729295Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695423729631 (+336 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695423729631Loading Region manifests for snaptb0-testExportWithTargetName at 1695423729631Writing data manifest for snaptb0-testExportWithTargetName at 1695423729642 (+11 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695423730063 (+421 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695423730079 (+16 ms) 2023-09-22 23:02:10,082 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 23:02:10,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 787 msec 2023-09-22 23:02:10,404 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:10,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 23:02:10,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:02:10,408 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408 2023-09-22 23:02:10,409 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34671, tgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408, rawTgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408, srcFsUri=hdfs://localhost:34671, srcDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:10,456 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:10,456 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-519224667_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-22 23:02:10,456 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0, snapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-22 23:02:10,478 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-22 23:02:10,550 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:10,551 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:10,551 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:10,552 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,503 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-5098221240734845871.jar 2023-09-22 23:02:11,504 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,504 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,573 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-7091382578563450205.jar 2023-09-22 23:02:11,573 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,574 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,574 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,575 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,575 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,576 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:11,576 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 23:02:11,577 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 23:02:11,578 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 23:02:11,579 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 23:02:11,579 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 23:02:11,580 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 23:02:11,581 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 23:02:11,581 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 23:02:11,582 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 23:02:11,582 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 23:02:11,586 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:11,586 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:11,587 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:11,587 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:11,587 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:11,588 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:11,588 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:13,161 WARN [Listener at jenkins-hbase4.apache.org/32797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 23:02:13,170 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-22 23:02:13,178 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-22 23:02:13,636 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:02:13,638 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:02:13,667 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 23:02:14,468 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0001_000001 (auth:SIMPLE) 2023-09-22 23:02:18,779 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0001_000001 (auth:SIMPLE) 2023-09-22 23:02:21,044 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0001_000001 (auth:SIMPLE) 2023-09-22 23:02:23,814 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0001_000001 (auth:SIMPLE) 2023-09-22 23:02:25,115 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 23:02:25,118 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 23:02:25,129 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-22 23:02:25,129 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 23:02:25,130 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 23:02:25,130 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-22 23:02:25,131 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-22 23:02:25,131 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-22 23:02:25,131 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408/.hbase-snapshot/testExportWithTargetName 2023-09-22 23:02:25,131 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-22 23:02:25,131 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423730408/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-22 23:02:25,142 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-22 23:02:25,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-22 23:02:25,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-22 23:02:25,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423745159"}]},"ts":"1695423745159"} 2023-09-22 23:02:25,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 23:02:25,161 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-22 23:02:25,163 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-22 23:02:25,165 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8b8112ed79bea35e9d27a7f24e51cece, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0ab842b57abfab5c8cc8d3f7628ac09, UNASSIGN}] 2023-09-22 23:02:25,167 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8b8112ed79bea35e9d27a7f24e51cece, UNASSIGN 2023-09-22 23:02:25,167 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0ab842b57abfab5c8cc8d3f7628ac09, UNASSIGN 2023-09-22 23:02:25,168 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8b8112ed79bea35e9d27a7f24e51cece, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:25,168 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d0ab842b57abfab5c8cc8d3f7628ac09, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:25,168 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423745168"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423745168"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423745168"}]},"ts":"1695423745168"} 2023-09-22 23:02:25,168 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423745168"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423745168"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423745168"}]},"ts":"1695423745168"} 2023-09-22 23:02:25,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure d0ab842b57abfab5c8cc8d3f7628ac09, server=jenkins-hbase4.apache.org,40697,1695423720223}] 2023-09-22 23:02:25,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 8b8112ed79bea35e9d27a7f24e51cece, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:02:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 23:02:25,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:25,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:25,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b8112ed79bea35e9d27a7f24e51cece, disabling compactions & flushes 2023-09-22 23:02:25,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0ab842b57abfab5c8cc8d3f7628ac09, disabling compactions & flushes 2023-09-22 23:02:25,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:25,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:25,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:25,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:25,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. after waiting 0 ms 2023-09-22 23:02:25,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. after waiting 0 ms 2023-09-22 23:02:25,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:25,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:25,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:02:25,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:02:25,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:02:25,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:02:25,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece. 2023-09-22 23:02:25,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09. 2023-09-22 23:02:25,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b8112ed79bea35e9d27a7f24e51cece: 2023-09-22 23:02:25,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0ab842b57abfab5c8cc8d3f7628ac09: 2023-09-22 23:02:25,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:25,352 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d0ab842b57abfab5c8cc8d3f7628ac09, regionState=CLOSED 2023-09-22 23:02:25,353 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423745352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423745352"}]},"ts":"1695423745352"} 2023-09-22 23:02:25,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:25,354 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8b8112ed79bea35e9d27a7f24e51cece, regionState=CLOSED 2023-09-22 23:02:25,354 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695423745353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423745353"}]},"ts":"1695423745353"} 2023-09-22 23:02:25,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-22 23:02:25,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure d0ab842b57abfab5c8cc8d3f7628ac09, server=jenkins-hbase4.apache.org,40697,1695423720223 in 185 msec 2023-09-22 23:02:25,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-22 23:02:25,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 8b8112ed79bea35e9d27a7f24e51cece, server=jenkins-hbase4.apache.org,38937,1695423720190 in 185 msec 2023-09-22 23:02:25,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0ab842b57abfab5c8cc8d3f7628ac09, UNASSIGN in 192 msec 2023-09-22 23:02:25,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-22 23:02:25,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8b8112ed79bea35e9d27a7f24e51cece, UNASSIGN in 194 msec 2023-09-22 23:02:25,362 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423745362"}]},"ts":"1695423745362"} 2023-09-22 23:02:25,363 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-22 23:02:25,365 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-22 23:02:25,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-09-22 23:02:25,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 23:02:25,463 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-22 23:02:25,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-22 23:02:25,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 23:02:25,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 23:02:25,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-22 23:02:25,479 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 23:02:25,483 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-22 23:02:25,485 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:25,485 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:25,487 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 23:02:25,487 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 23:02:25,487 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 23:02:25,487 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 23:02:25,489 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:25,489 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:25,489 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:25,489 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:25,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 23:02:25,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 23:02:25,489 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 23:02:25,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 23:02:25,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 23:02:25,489 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 23:02:25,489 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/recovered.edits] 2023-09-22 23:02:25,489 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/recovered.edits] 2023-09-22 23:02:25,489 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 23:02:25,489 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 23:02:25,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-22 23:02:25,497 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf/acd054732b5644eaa896c438ba7994f4 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/cf/acd054732b5644eaa896c438ba7994f4 2023-09-22 23:02:25,497 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf/23a83c58269d46659076e00893029dd1 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/cf/23a83c58269d46659076e00893029dd1 2023-09-22 23:02:25,501 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09/recovered.edits/9.seqid 2023-09-22 23:02:25,501 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece/recovered.edits/9.seqid 2023-09-22 23:02:25,501 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/d0ab842b57abfab5c8cc8d3f7628ac09 2023-09-22 23:02:25,501 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportWithTargetName/8b8112ed79bea35e9d27a7f24e51cece 2023-09-22 23:02:25,502 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-22 23:02:25,502 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-22 23:02:25,503 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-22 23:02:25,507 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9d03651adb041b9aaf0457e1b3cdeda to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9d03651adb041b9aaf0457e1b3cdeda 2023-09-22 23:02:25,509 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230922d2d67c08597f44588862ba3fdb1dcf62 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230922d2d67c08597f44588862ba3fdb1dcf62 2023-09-22 23:02:25,509 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-22 23:02:25,512 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 23:02:25,534 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-22 23:02:25,537 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-22 23:02:25,539 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 23:02:25,539 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-22 23:02:25,539 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423745539"}]},"ts":"9223372036854775807"} 2023-09-22 23:02:25,539 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423745539"}]},"ts":"9223372036854775807"} 2023-09-22 23:02:25,541 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 23:02:25,541 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8b8112ed79bea35e9d27a7f24e51cece, NAME => 'testtb-testExportWithTargetName,,1695423727621.8b8112ed79bea35e9d27a7f24e51cece.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d0ab842b57abfab5c8cc8d3f7628ac09, NAME => 'testtb-testExportWithTargetName,1,1695423727621.d0ab842b57abfab5c8cc8d3f7628ac09.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 23:02:25,541 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-22 23:02:25,541 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695423745541"}]},"ts":"9223372036854775807"} 2023-09-22 23:02:25,543 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-22 23:02:25,545 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 23:02:25,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 76 msec 2023-09-22 23:02:25,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-22 23:02:25,595 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-22 23:02:25,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-22 23:02:25,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-22 23:02:25,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-22 23:02:25,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-22 23:02:25,652 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 709) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_909470_1 at /127.0.0.1:41180 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:38819 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:47802 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1285 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:41198 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:42602 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_909470_1 at /127.0.0.1:42574 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:41419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:43087 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x15efe84-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x15efe84-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=175 (was 131) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1643 (was 2415) 2023-09-22 23:02:25,653 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-22 23:02:25,672 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=175, ProcessCount=168, AvailableMemoryMB=1642 2023-09-22 23:02:25,672 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-22 23:02:25,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 23:02:25,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-22 23:02:25,678 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:02:25,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-22 23:02:25,681 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:02:25,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 23:02:25,684 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:25,684 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:25,685 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae empty. 2023-09-22 23:02:25,685 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca empty. 2023-09-22 23:02:25,685 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:25,685 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:25,685 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-22 23:02:25,705 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-22 23:02:25,706 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c2d901f54a4020cad0913ce5171783ae, NAME => 'testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:02:25,706 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 71ae1b0f5b8e4270a01cfbdf62076cca, NAME => 'testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:02:25,734 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:25,734 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 71ae1b0f5b8e4270a01cfbdf62076cca, disabling compactions & flushes 2023-09-22 23:02:25,734 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:25,734 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:25,734 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:25,734 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. after waiting 0 ms 2023-09-22 23:02:25,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c2d901f54a4020cad0913ce5171783ae, disabling compactions & flushes 2023-09-22 23:02:25,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:25,735 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:25,735 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:25,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 71ae1b0f5b8e4270a01cfbdf62076cca: 2023-09-22 23:02:25,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:25,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. after waiting 0 ms 2023-09-22 23:02:25,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:25,736 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:25,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c2d901f54a4020cad0913ce5171783ae: 2023-09-22 23:02:25,739 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:02:25,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423745740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423745740"}]},"ts":"1695423745740"} 2023-09-22 23:02:25,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423745740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423745740"}]},"ts":"1695423745740"} 2023-09-22 23:02:25,742 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 23:02:25,744 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:02:25,744 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423745744"}]},"ts":"1695423745744"} 2023-09-22 23:02:25,746 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-22 23:02:25,750 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:02:25,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:02:25,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:02:25,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:02:25,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:02:25,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2d901f54a4020cad0913ce5171783ae, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=71ae1b0f5b8e4270a01cfbdf62076cca, ASSIGN}] 2023-09-22 23:02:25,754 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=71ae1b0f5b8e4270a01cfbdf62076cca, ASSIGN 2023-09-22 23:02:25,754 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2d901f54a4020cad0913ce5171783ae, ASSIGN 2023-09-22 23:02:25,755 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=71ae1b0f5b8e4270a01cfbdf62076cca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37507,1695423720143; forceNewPlan=false, retain=false 2023-09-22 23:02:25,756 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2d901f54a4020cad0913ce5171783ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38937,1695423720190; forceNewPlan=false, retain=false 2023-09-22 23:02:25,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 23:02:25,905 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 23:02:25,908 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c2d901f54a4020cad0913ce5171783ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:25,908 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=71ae1b0f5b8e4270a01cfbdf62076cca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:25,908 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423745908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423745908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423745908"}]},"ts":"1695423745908"} 2023-09-22 23:02:25,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423745908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423745908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423745908"}]},"ts":"1695423745908"} 2023-09-22 23:02:25,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 71ae1b0f5b8e4270a01cfbdf62076cca, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:02:25,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure c2d901f54a4020cad0913ce5171783ae, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:02:25,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 23:02:26,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:26,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2d901f54a4020cad0913ce5171783ae, NAME => 'testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 23:02:26,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71ae1b0f5b8e4270a01cfbdf62076cca, NAME => 'testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 23:02:26,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. service=AccessControlService 2023-09-22 23:02:26,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:26,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:26,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:26,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. service=AccessControlService 2023-09-22 23:02:26,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:26,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:26,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:26,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:26,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:26,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:26,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:26,075 INFO [StoreOpener-c2d901f54a4020cad0913ce5171783ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:26,075 INFO [StoreOpener-71ae1b0f5b8e4270a01cfbdf62076cca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:26,076 DEBUG [StoreOpener-c2d901f54a4020cad0913ce5171783ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf 2023-09-22 23:02:26,077 DEBUG [StoreOpener-c2d901f54a4020cad0913ce5171783ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf 2023-09-22 23:02:26,077 DEBUG [StoreOpener-71ae1b0f5b8e4270a01cfbdf62076cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf 2023-09-22 23:02:26,077 DEBUG [StoreOpener-71ae1b0f5b8e4270a01cfbdf62076cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf 2023-09-22 23:02:26,077 INFO [StoreOpener-c2d901f54a4020cad0913ce5171783ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2d901f54a4020cad0913ce5171783ae columnFamilyName cf 2023-09-22 23:02:26,077 INFO [StoreOpener-71ae1b0f5b8e4270a01cfbdf62076cca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71ae1b0f5b8e4270a01cfbdf62076cca columnFamilyName cf 2023-09-22 23:02:26,079 INFO [StoreOpener-c2d901f54a4020cad0913ce5171783ae-1] regionserver.HStore(310): Store=c2d901f54a4020cad0913ce5171783ae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:26,080 INFO [StoreOpener-71ae1b0f5b8e4270a01cfbdf62076cca-1] regionserver.HStore(310): Store=71ae1b0f5b8e4270a01cfbdf62076cca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:26,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:26,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:26,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:26,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:26,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:26,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:26,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:26,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2d901f54a4020cad0913ce5171783ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63478584, jitterRate=-0.05409538745880127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:26,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2d901f54a4020cad0913ce5171783ae: 2023-09-22 23:02:26,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae., pid=31, masterSystemTime=1695423746066 2023-09-22 23:02:26,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:26,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 71ae1b0f5b8e4270a01cfbdf62076cca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62957985, jitterRate=-0.061852917075157166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:26,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 71ae1b0f5b8e4270a01cfbdf62076cca: 2023-09-22 23:02:26,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca., pid=30, masterSystemTime=1695423746063 2023-09-22 23:02:26,092 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c2d901f54a4020cad0913ce5171783ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423746092"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423746092"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423746092"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423746092"}]},"ts":"1695423746092"} 2023-09-22 23:02:26,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:26,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:26,094 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=71ae1b0f5b8e4270a01cfbdf62076cca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,095 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423746094"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423746094"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423746094"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423746094"}]},"ts":"1695423746094"} 2023-09-22 23:02:26,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-22 23:02:26,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure c2d901f54a4020cad0913ce5171783ae, server=jenkins-hbase4.apache.org,38937,1695423720190 in 183 msec 2023-09-22 23:02:26,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-22 23:02:26,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 71ae1b0f5b8e4270a01cfbdf62076cca, server=jenkins-hbase4.apache.org,37507,1695423720143 in 186 msec 2023-09-22 23:02:26,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2d901f54a4020cad0913ce5171783ae, ASSIGN in 347 msec 2023-09-22 23:02:26,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-22 23:02:26,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=71ae1b0f5b8e4270a01cfbdf62076cca, ASSIGN in 350 msec 2023-09-22 23:02:26,105 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:02:26,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423746105"}]},"ts":"1695423746105"} 2023-09-22 23:02:26,107 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-22 23:02:26,109 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:02:26,110 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-22 23:02:26,112 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 23:02:26,113 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:26,113 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:26,113 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:26,113 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:26,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:26,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:26,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:26,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:26,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 440 msec 2023-09-22 23:02:26,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 23:02:26,285 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-22 23:02:26,288 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-22 23:02:26,288 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,290 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:02:26,302 DEBUG [hconnection-0x5f69858d-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:26,306 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:26,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:02:26,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423746310 (current time:1695423746310). 2023-09-22 23:02:26,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:02:26,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x5dc4523d to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:26,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f8beb24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:26,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:26,323 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:26,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dc4523d to 127.0.0.1:57942 2023-09-22 23:02:26,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:26,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x0dfd16c2 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:26,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72d7f8fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:26,333 DEBUG [hconnection-0x52a5ef4f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:26,336 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:26,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:26,343 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:26,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dfd16c2 to 127.0.0.1:57942 2023-09-22 23:02:26,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:26,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 23:02:26,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:02:26,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:02:26,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:02:26,350 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:02:26,351 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695424346351 2023-09-22 23:02:26,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:02:26,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-22 23:02:26,353 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:02:26,353 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:02:26,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 23:02:26,355 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:02:26,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-22 23:02:26,358 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 23:02:26,359 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695424346359 2023-09-22 23:02:26,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,382 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-22 23:02:26,382 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:26,384 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-22 23:02:26,384 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-22 23:02:26,384 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,384 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,387 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,387 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,387 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,387 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,388 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 23:02:26,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,388 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 23:02:26,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 23:02:26,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 23:02:26,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 23:02:26,390 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 23:02:26,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,390 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 23:02:26,390 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:26,390 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 23:02:26,389 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,391 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:02:26,391 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 23:02:26,390 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:26,391 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 23:02:26,392 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 23:02:26,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,394 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 23:02:26,394 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 23:02:26,394 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:26,394 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 23:02:26,396 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,396 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,396 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 23:02:26,396 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 23:02:26,396 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,396 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:26,396 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 23:02:26,397 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 23:02:26,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,406 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,406 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,408 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,408 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,408 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:26,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,408 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,408 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:26,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-22 23:02:26,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46870679[Count = 1] remaining members to acquire global barrier 2023-09-22 23:02:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-22 23:02:26,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46870679[Count = 0] remaining members to acquire global barrier 2023-09-22 23:02:26,414 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 23:02:26,414 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:02:26,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:02:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:02:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 23:02:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:02:26,417 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,420 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 23:02:26,420 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:26,420 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 23:02:26,420 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,420 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:02:26,425 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:26,428 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:26,428 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,427 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:26,428 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. started... 2023-09-22 23:02:26,428 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:26,428 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:26,429 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. started... 2023-09-22 23:02:26,429 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2d901f54a4020cad0913ce5171783ae: 2023-09-22 23:02:26,430 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 71ae1b0f5b8e4270a01cfbdf62076cca: 2023-09-22 23:02:26,430 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,430 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,430 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:26,430 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:26,430 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:02:26,430 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:02:26,453 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. completed. 2023-09-22 23:02:26,453 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 23:02:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:02:26,453 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. completed. 2023-09-22 23:02:26,453 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:26,453 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 23:02:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:02:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 23:02:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:02:26,455 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:02:26,455 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 23:02:26,455 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,455 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,455 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 23:02:26,457 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:02:26,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 23:02:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37507,1695423720143': 2023-09-22 23:02:26,469 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 23:02:26,469 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-22 23:02:26,469 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:02:26,469 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:02:26,469 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:26,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 23:02:26,469 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 23:02:26,469 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,471 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:02:26,473 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,473 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,474 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,476 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,476 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,479 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,479 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,479 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,488 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,488 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,488 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,488 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,488 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,488 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,488 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,488 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,490 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,488 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-22 23:02:26,488 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,490 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:02:26,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,490 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,491 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,492 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,492 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,492 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 23:02:26,492 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,492 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,492 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,534 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-22 23:02:26,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,534 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:26,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695423746352Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695423746504 (+152 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695423746504Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695423746504Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695423746508 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695423746517 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695423746534 (+17 ms) 2023-09-22 23:02:26,536 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 23:02:26,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 183 msec 2023-09-22 23:02:26,655 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:26,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 23:02:26,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:02:26,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38937] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:02:26,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37507] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:02:26,667 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-22 23:02:26,667 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,668 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:02:26,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:02:26,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423746680 (current time:1695423746680). 2023-09-22 23:02:26,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:02:26,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x1b4830cd to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:26,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d3c940a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:26,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:26,692 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:26,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b4830cd to 127.0.0.1:57942 2023-09-22 23:02:26,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:26,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x3928ab8e to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:26,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ad96e87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:26,702 DEBUG [hconnection-0x1c9d2da6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:26,703 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:26,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:26,709 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:26,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3928ab8e to 127.0.0.1:57942 2023-09-22 23:02:26,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:26,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 23:02:26,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:02:26,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:02:26,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:02:26,714 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:02:26,715 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695424346715 2023-09-22 23:02:26,715 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-22 23:02:26,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:02:26,717 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:02:26,717 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:02:26,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 23:02:26,719 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:02:26,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-22 23:02:26,722 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 23:02:26,723 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695424346722 2023-09-22 23:02:26,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-22 23:02:26,742 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-22 23:02:26,742 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:26,743 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-22 23:02:26,743 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-22 23:02:26,744 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,744 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,745 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,745 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,745 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,745 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,746 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,746 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,746 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,746 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 23:02:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 23:02:26,748 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 23:02:26,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 23:02:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 23:02:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 23:02:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:26,752 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 23:02:26,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 23:02:26,752 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 23:02:26,752 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 23:02:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 23:02:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 23:02:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 23:02:26,754 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 23:02:26,754 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 23:02:26,754 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 23:02:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 23:02:26,755 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,756 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,756 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,756 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,756 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:26,756 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,757 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,757 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,757 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,757 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-22 23:02:26,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a9c1c9d[Count = 1] remaining members to acquire global barrier 2023-09-22 23:02:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-22 23:02:26,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a9c1c9d[Count = 0] remaining members to acquire global barrier 2023-09-22 23:02:26,761 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 23:02:26,761 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,763 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:02:26,763 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 23:02:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:02:26,763 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:02:26,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,763 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,763 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:02:26,763 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:02:26,763 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:26,764 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:26,764 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:26,764 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:26,764 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:26,764 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,764 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. started... 2023-09-22 23:02:26,764 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. started... 2023-09-22 23:02:26,764 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2d901f54a4020cad0913ce5171783ae 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-22 23:02:26,764 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 71ae1b0f5b8e4270a01cfbdf62076cca 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-22 23:02:26,765 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 23:02:26,765 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:26,765 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 23:02:26,799 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922186cce9d7f5045c08bf41475925767a2 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922186cce9d7f5045c08bf41475925767a2 2023-09-22 23:02:26,806 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922d616912d0c4240e59ab62791b0bf6999 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922d616912d0c4240e59ab62791b0bf6999 2023-09-22 23:02:26,817 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:26,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 23:02:26,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:02:26,826 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:02:26,828 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/.tmp/cf/a13e11aab6d448eeaf04b58ec5535cae 2023-09-22 23:02:26,831 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/.tmp/cf/f596ff1f41404c5d9bf5c3097a21af7d 2023-09-22 23:02:26,836 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/.tmp/cf/a13e11aab6d448eeaf04b58ec5535cae as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf/a13e11aab6d448eeaf04b58ec5535cae 2023-09-22 23:02:26,839 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/.tmp/cf/f596ff1f41404c5d9bf5c3097a21af7d as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf/f596ff1f41404c5d9bf5c3097a21af7d 2023-09-22 23:02:26,843 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf/a13e11aab6d448eeaf04b58ec5535cae, entries=4, sequenceid=6, filesize=5.6 K 2023-09-22 23:02:26,844 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for c2d901f54a4020cad0913ce5171783ae in 80ms, sequenceid=6, compaction requested=false 2023-09-22 23:02:26,844 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-22 23:02:26,845 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2d901f54a4020cad0913ce5171783ae: 2023-09-22 23:02:26,845 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 23:02:26,845 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:26,845 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf/a13e11aab6d448eeaf04b58ec5535cae] hfiles 2023-09-22 23:02:26,845 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf/a13e11aab6d448eeaf04b58ec5535cae for snapshot=snaptb0-testExportFileSystemState 2023-09-22 23:02:26,845 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf/f596ff1f41404c5d9bf5c3097a21af7d, entries=46, sequenceid=6, filesize=12.7 K 2023-09-22 23:02:26,847 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 71ae1b0f5b8e4270a01cfbdf62076cca in 82ms, sequenceid=6, compaction requested=false 2023-09-22 23:02:26,848 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 71ae1b0f5b8e4270a01cfbdf62076cca: 2023-09-22 23:02:26,849 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 23:02:26,849 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:26,849 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf/f596ff1f41404c5d9bf5c3097a21af7d] hfiles 2023-09-22 23:02:26,849 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf/f596ff1f41404c5d9bf5c3097a21af7d for snapshot=snaptb0-testExportFileSystemState 2023-09-22 23:02:26,861 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. completed. 2023-09-22 23:02:26,861 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 23:02:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:02:26,868 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 23:02:26,868 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,868 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,868 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 23:02:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,871 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. completed. 2023-09-22 23:02:26,872 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 23:02:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:02:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,874 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,874 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 23:02:26,874 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:26,874 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 23:02:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:02:26,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 23:02:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37507,1695423720143': 2023-09-22 23:02:26,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 23:02:26,880 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-22 23:02:26,880 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:02:26,880 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:02:26,880 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-22 23:02:26,880 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:02:26,882 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:26,882 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,882 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:26,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:26,883 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,884 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,884 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:26,886 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 23:02:26,886 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,887 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,891 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,891 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,891 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,891 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:26,891 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:26,892 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,891 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,892 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,892 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-22 23:02:26,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-22 23:02:26,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 23:02:26,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:02:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:26,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,893 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,895 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,895 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,895 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:26,895 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,895 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:26,895 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:26,895 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,895 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:26,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922d616912d0c4240e59ab62791b0bf6999, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922186cce9d7f5045c08bf41475925767a2] mob files 2023-09-22 23:02:26,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922d616912d0c4240e59ab62791b0bf6999 2023-09-22 23:02:26,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922186cce9d7f5045c08bf41475925767a2 2023-09-22 23:02:26,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-22 23:02:26,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,935 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-22 23:02:26,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,935 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 23:02:26,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695423746715Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695423746905 (+190 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695423746905Loading Region manifests for snaptb0-testExportFileSystemState at 1695423746905Writing data manifest for snaptb0-testExportFileSystemState at 1695423746918 (+13 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695423746926 (+8 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695423746935 (+9 ms) 2023-09-22 23:02:26,938 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 23:02:26,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 222 msec 2023-09-22 23:02:27,026 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:27,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 23:02:27,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:02:27,028 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028 2023-09-22 23:02:27,028 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34671, tgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028, rawTgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028, srcFsUri=hdfs://localhost:34671, srcDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:27,064 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:27,064 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-285321595_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 23:02:27,064 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0, snapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-22 23:02:27,078 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 23:02:27,104 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:27,105 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:27,105 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:27,106 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,047 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-6465641980897806773.jar 2023-09-22 23:02:28,048 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,048 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,115 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-9195904660184106330.jar 2023-09-22 23:02:28,116 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,116 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,117 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,117 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,117 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,118 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:28,118 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 23:02:28,119 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 23:02:28,119 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 23:02:28,119 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 23:02:28,120 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 23:02:28,120 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 23:02:28,121 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 23:02:28,121 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 23:02:28,121 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 23:02:28,122 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 23:02:28,122 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:28,123 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:28,123 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:28,124 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:28,124 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:28,125 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:28,126 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:28,565 WARN [Listener at jenkins-hbase4.apache.org/32797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 23:02:28,568 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-22 23:02:28,570 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-22 23:02:30,005 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:02:30,005 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:02:30,012 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0001_000001 (auth:SIMPLE) 2023-09-22 23:02:30,534 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0002_000001 (auth:SIMPLE) 2023-09-22 23:02:30,935 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 23:02:34,583 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0002_000001 (auth:SIMPLE) 2023-09-22 23:02:36,804 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0002_000001 (auth:SIMPLE) 2023-09-22 23:02:39,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0002_000001 (auth:SIMPLE) 2023-09-22 23:02:41,171 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 23:02:41,172 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 23:02:41,181 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-22 23:02:41,181 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 23:02:41,182 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 23:02:41,182 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 23:02:41,182 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-22 23:02:41,182 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-22 23:02:41,182 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 23:02:41,183 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-22 23:02:41,183 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423747028/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-22 23:02:41,191 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-22 23:02:41,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-22 23:02:41,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-22 23:02:41,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 23:02:41,196 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423761196"}]},"ts":"1695423761196"} 2023-09-22 23:02:41,198 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-22 23:02:41,199 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-22 23:02:41,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2d901f54a4020cad0913ce5171783ae, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=71ae1b0f5b8e4270a01cfbdf62076cca, UNASSIGN}] 2023-09-22 23:02:41,202 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2d901f54a4020cad0913ce5171783ae, UNASSIGN 2023-09-22 23:02:41,203 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=71ae1b0f5b8e4270a01cfbdf62076cca, UNASSIGN 2023-09-22 23:02:41,203 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c2d901f54a4020cad0913ce5171783ae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:41,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=71ae1b0f5b8e4270a01cfbdf62076cca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:41,204 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423761203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423761203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423761203"}]},"ts":"1695423761203"} 2023-09-22 23:02:41,204 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423761203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423761203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423761203"}]},"ts":"1695423761203"} 2023-09-22 23:02:41,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 71ae1b0f5b8e4270a01cfbdf62076cca, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:02:41,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure c2d901f54a4020cad0913ce5171783ae, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:02:41,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 23:02:41,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:41,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 71ae1b0f5b8e4270a01cfbdf62076cca, disabling compactions & flushes 2023-09-22 23:02:41,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:41,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:41,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. after waiting 0 ms 2023-09-22 23:02:41,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:41,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:41,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2d901f54a4020cad0913ce5171783ae, disabling compactions & flushes 2023-09-22 23:02:41,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:41,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:41,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. after waiting 0 ms 2023-09-22 23:02:41,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:41,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:02:41,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:02:41,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:02:41,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca. 2023-09-22 23:02:41,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 71ae1b0f5b8e4270a01cfbdf62076cca: 2023-09-22 23:02:41,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:02:41,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae. 2023-09-22 23:02:41,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2d901f54a4020cad0913ce5171783ae: 2023-09-22 23:02:41,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:41,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=71ae1b0f5b8e4270a01cfbdf62076cca, regionState=CLOSED 2023-09-22 23:02:41,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:41,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423761372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423761372"}]},"ts":"1695423761372"} 2023-09-22 23:02:41,373 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c2d901f54a4020cad0913ce5171783ae, regionState=CLOSED 2023-09-22 23:02:41,373 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695423761373"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423761373"}]},"ts":"1695423761373"} 2023-09-22 23:02:41,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-22 23:02:41,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 71ae1b0f5b8e4270a01cfbdf62076cca, server=jenkins-hbase4.apache.org,37507,1695423720143 in 169 msec 2023-09-22 23:02:41,377 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-22 23:02:41,377 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure c2d901f54a4020cad0913ce5171783ae, server=jenkins-hbase4.apache.org,38937,1695423720190 in 169 msec 2023-09-22 23:02:41,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=71ae1b0f5b8e4270a01cfbdf62076cca, UNASSIGN in 176 msec 2023-09-22 23:02:41,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-22 23:02:41,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2d901f54a4020cad0913ce5171783ae, UNASSIGN in 177 msec 2023-09-22 23:02:41,379 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423761379"}]},"ts":"1695423761379"} 2023-09-22 23:02:41,381 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-22 23:02:41,382 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-22 23:02:41,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 192 msec 2023-09-22 23:02:41,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 23:02:41,498 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-22 23:02:41,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-22 23:02:41,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 23:02:41,503 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 23:02:41,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-22 23:02:41,504 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 23:02:41,506 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-22 23:02:41,509 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:41,510 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 23:02:41,510 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 23:02:41,510 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 23:02:41,510 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 23:02:41,510 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:41,510 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 23:02:41,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 23:02:41,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 23:02:41,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 23:02:41,512 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 23:02:41,512 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:41,512 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 23:02:41,512 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 23:02:41,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:41,512 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 23:02:41,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-22 23:02:41,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:41,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:41,514 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/recovered.edits] 2023-09-22 23:02:41,518 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf/a13e11aab6d448eeaf04b58ec5535cae to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/cf/a13e11aab6d448eeaf04b58ec5535cae 2023-09-22 23:02:41,521 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae/recovered.edits/9.seqid 2023-09-22 23:02:41,521 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/recovered.edits] 2023-09-22 23:02:41,522 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/c2d901f54a4020cad0913ce5171783ae 2023-09-22 23:02:41,525 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf/f596ff1f41404c5d9bf5c3097a21af7d to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/cf/f596ff1f41404c5d9bf5c3097a21af7d 2023-09-22 23:02:41,530 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca/recovered.edits/9.seqid 2023-09-22 23:02:41,530 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemState/71ae1b0f5b8e4270a01cfbdf62076cca 2023-09-22 23:02:41,531 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-22 23:02:41,531 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-22 23:02:41,532 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-22 23:02:41,535 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922d616912d0c4240e59ab62791b0bf6999 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922d616912d0c4240e59ab62791b0bf6999 2023-09-22 23:02:41,537 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922186cce9d7f5045c08bf41475925767a2 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922186cce9d7f5045c08bf41475925767a2 2023-09-22 23:02:41,537 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-22 23:02:41,540 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 23:02:41,543 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-22 23:02:41,545 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-22 23:02:41,546 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 23:02:41,546 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-22 23:02:41,547 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423761546"}]},"ts":"9223372036854775807"} 2023-09-22 23:02:41,547 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423761546"}]},"ts":"9223372036854775807"} 2023-09-22 23:02:41,549 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 23:02:41,549 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c2d901f54a4020cad0913ce5171783ae, NAME => 'testtb-testExportFileSystemState,,1695423745673.c2d901f54a4020cad0913ce5171783ae.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 71ae1b0f5b8e4270a01cfbdf62076cca, NAME => 'testtb-testExportFileSystemState,1,1695423745673.71ae1b0f5b8e4270a01cfbdf62076cca.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 23:02:41,549 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-22 23:02:41,549 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695423761549"}]},"ts":"9223372036854775807"} 2023-09-22 23:02:41,552 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-22 23:02:41,554 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 23:02:41,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 55 msec 2023-09-22 23:02:41,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-22 23:02:41,615 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-22 23:02:41,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-22 23:02:41,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-22 23:02:41,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-22 23:02:41,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-22 23:02:41,653 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 755) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:42072 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_498421845_1 at /127.0.0.1:52614 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:32797 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:53358 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:52624 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:38337 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x15efe84-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1966 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_498421845_1 at /127.0.0.1:42048 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=941 (was 924) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 175) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1545 (was 1642) 2023-09-22 23:02:41,653 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-22 23:02:41,671 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=941, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=168, AvailableMemoryMB=1544 2023-09-22 23:02:41,671 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-22 23:02:41,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 23:02:41,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-22 23:02:41,676 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:02:41,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-22 23:02:41,677 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:02:41,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 23:02:41,680 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:41,680 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:41,680 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4 empty. 2023-09-22 23:02:41,680 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392 empty. 2023-09-22 23:02:41,681 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:41,681 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:41,681 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-22 23:02:41,691 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-22 23:02:41,692 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2e22a84b24715a33227c61a22970a9b4, NAME => 'testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:02:41,692 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8e9074ae79b3259bdb145cb42e5c0392, NAME => 'testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:02:41,702 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:41,702 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 2e22a84b24715a33227c61a22970a9b4, disabling compactions & flushes 2023-09-22 23:02:41,702 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:41,702 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:41,702 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. after waiting 0 ms 2023-09-22 23:02:41,702 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:41,702 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:41,702 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 2e22a84b24715a33227c61a22970a9b4: 2023-09-22 23:02:41,703 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:41,703 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8e9074ae79b3259bdb145cb42e5c0392, disabling compactions & flushes 2023-09-22 23:02:41,703 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:41,703 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:41,703 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. after waiting 0 ms 2023-09-22 23:02:41,703 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:41,703 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:41,703 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8e9074ae79b3259bdb145cb42e5c0392: 2023-09-22 23:02:41,706 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:02:41,707 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423761707"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423761707"}]},"ts":"1695423761707"} 2023-09-22 23:02:41,707 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423761707"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423761707"}]},"ts":"1695423761707"} 2023-09-22 23:02:41,709 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 23:02:41,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:02:41,710 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423761710"}]},"ts":"1695423761710"} 2023-09-22 23:02:41,712 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-22 23:02:41,716 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:02:41,717 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:02:41,717 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:02:41,717 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:02:41,717 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:02:41,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2e22a84b24715a33227c61a22970a9b4, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e9074ae79b3259bdb145cb42e5c0392, ASSIGN}] 2023-09-22 23:02:41,720 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e9074ae79b3259bdb145cb42e5c0392, ASSIGN 2023-09-22 23:02:41,720 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2e22a84b24715a33227c61a22970a9b4, ASSIGN 2023-09-22 23:02:41,721 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e9074ae79b3259bdb145cb42e5c0392, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38937,1695423720190; forceNewPlan=false, retain=false 2023-09-22 23:02:41,722 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2e22a84b24715a33227c61a22970a9b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37507,1695423720143; forceNewPlan=false, retain=false 2023-09-22 23:02:41,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 23:02:41,872 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 23:02:41,875 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2e22a84b24715a33227c61a22970a9b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:41,875 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8e9074ae79b3259bdb145cb42e5c0392, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:41,875 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423761874"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423761874"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423761874"}]},"ts":"1695423761874"} 2023-09-22 23:02:41,875 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423761874"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423761874"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423761874"}]},"ts":"1695423761874"} 2023-09-22 23:02:41,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 2e22a84b24715a33227c61a22970a9b4, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:02:41,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 8e9074ae79b3259bdb145cb42e5c0392, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:02:41,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 23:02:42,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e22a84b24715a33227c61a22970a9b4, NAME => 'testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 23:02:42,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:42,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e9074ae79b3259bdb145cb42e5c0392, NAME => 'testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 23:02:42,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. service=AccessControlService 2023-09-22 23:02:42,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. service=AccessControlService 2023-09-22 23:02:42,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:42,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:02:42,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:42,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:42,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:42,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:02:42,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:42,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:42,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:42,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:42,035 INFO [StoreOpener-8e9074ae79b3259bdb145cb42e5c0392-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:42,035 INFO [StoreOpener-2e22a84b24715a33227c61a22970a9b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:42,036 DEBUG [StoreOpener-8e9074ae79b3259bdb145cb42e5c0392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf 2023-09-22 23:02:42,037 DEBUG [StoreOpener-8e9074ae79b3259bdb145cb42e5c0392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf 2023-09-22 23:02:42,037 DEBUG [StoreOpener-2e22a84b24715a33227c61a22970a9b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf 2023-09-22 23:02:42,037 DEBUG [StoreOpener-2e22a84b24715a33227c61a22970a9b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf 2023-09-22 23:02:42,037 INFO [StoreOpener-8e9074ae79b3259bdb145cb42e5c0392-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e9074ae79b3259bdb145cb42e5c0392 columnFamilyName cf 2023-09-22 23:02:42,037 INFO [StoreOpener-2e22a84b24715a33227c61a22970a9b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e22a84b24715a33227c61a22970a9b4 columnFamilyName cf 2023-09-22 23:02:42,038 INFO [StoreOpener-2e22a84b24715a33227c61a22970a9b4-1] regionserver.HStore(310): Store=2e22a84b24715a33227c61a22970a9b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:42,038 INFO [StoreOpener-8e9074ae79b3259bdb145cb42e5c0392-1] regionserver.HStore(310): Store=8e9074ae79b3259bdb145cb42e5c0392/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:02:42,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:42,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:42,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:42,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:42,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:02:42,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:02:42,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:42,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:02:42,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e22a84b24715a33227c61a22970a9b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65543275, jitterRate=-0.02332909405231476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:42,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e22a84b24715a33227c61a22970a9b4: 2023-09-22 23:02:42,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8e9074ae79b3259bdb145cb42e5c0392; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74896608, jitterRate=0.11604642868041992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:02:42,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8e9074ae79b3259bdb145cb42e5c0392: 2023-09-22 23:02:42,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4., pid=45, masterSystemTime=1695423762029 2023-09-22 23:02:42,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392., pid=46, masterSystemTime=1695423762029 2023-09-22 23:02:42,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,049 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2e22a84b24715a33227c61a22970a9b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:42,049 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423762049"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423762049"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423762049"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423762049"}]},"ts":"1695423762049"} 2023-09-22 23:02:42,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:42,050 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8e9074ae79b3259bdb145cb42e5c0392, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,050 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423762049"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423762049"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423762049"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423762049"}]},"ts":"1695423762049"} 2023-09-22 23:02:42,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-22 23:02:42,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 2e22a84b24715a33227c61a22970a9b4, server=jenkins-hbase4.apache.org,37507,1695423720143 in 174 msec 2023-09-22 23:02:42,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-22 23:02:42,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 8e9074ae79b3259bdb145cb42e5c0392, server=jenkins-hbase4.apache.org,38937,1695423720190 in 174 msec 2023-09-22 23:02:42,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2e22a84b24715a33227c61a22970a9b4, ASSIGN in 336 msec 2023-09-22 23:02:42,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-22 23:02:42,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e9074ae79b3259bdb145cb42e5c0392, ASSIGN in 337 msec 2023-09-22 23:02:42,056 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:02:42,057 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423762057"}]},"ts":"1695423762057"} 2023-09-22 23:02:42,058 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-22 23:02:42,061 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:02:42,061 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-22 23:02:42,063 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 23:02:42,064 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:42,064 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:42,064 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:42,064 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:02:42,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:42,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:42,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:42,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 23:02:42,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 393 msec 2023-09-22 23:02:42,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 23:02:42,281 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-22 23:02:42,283 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-22 23:02:42,284 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,286 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:02:42,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 23:02:42,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423762298 (current time:1695423762298). 2023-09-22 23:02:42,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:02:42,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x601cca7e to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:42,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57e0814c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:42,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:42,312 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:42,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x601cca7e to 127.0.0.1:57942 2023-09-22 23:02:42,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:42,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x225a9aaf to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:42,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2413fba0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:42,321 DEBUG [hconnection-0x772ae48f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:42,323 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:42,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:42,328 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:42,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x225a9aaf to 127.0.0.1:57942 2023-09-22 23:02:42,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:42,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 23:02:42,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:02:42,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 23:02:42,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 23:02:42,333 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 23:02:42,333 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695424362333 2023-09-22 23:02:42,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 23:02:42,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-22 23:02:42,334 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:02:42,335 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:02:42,336 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 23:02:42,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 23:02:42,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-22 23:02:42,338 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 23:02:42,338 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695424362338 2023-09-22 23:02:42,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,348 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-22 23:02:42,348 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:42,349 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-22 23:02:42,349 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-22 23:02:42,349 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,349 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,351 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,351 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,351 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,351 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,351 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,351 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,352 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,352 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 23:02:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,353 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 23:02:42,353 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 23:02:42,353 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:42,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,353 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 23:02:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 23:02:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 23:02:42,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 23:02:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 23:02:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:42,355 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 23:02:42,358 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 23:02:42,358 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 23:02:42,358 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 23:02:42,358 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 23:02:42,358 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 23:02:42,359 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,359 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,360 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,360 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,362 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,362 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,362 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:42,362 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,362 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:42,362 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,363 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-22 23:02:42,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7317f87d[Count = 1] remaining members to acquire global barrier 2023-09-22 23:02:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-22 23:02:42,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7317f87d[Count = 0] remaining members to acquire global barrier 2023-09-22 23:02:42,366 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-22 23:02:42,366 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 23:02:42,368 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:42,368 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 23:02:42,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,368 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:42,368 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. started... 2023-09-22 23:02:42,368 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:42,368 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:42,368 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. started... 2023-09-22 23:02:42,368 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,368 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2e22a84b24715a33227c61a22970a9b4: 2023-09-22 23:02:42,368 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 23:02:42,369 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9074ae79b3259bdb145cb42e5c0392: 2023-09-22 23:02:42,368 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:02:42,369 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,368 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:42,370 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:42,370 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,370 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:02:42,370 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:42,369 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 23:02:42,370 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:02:42,370 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:02:42,378 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 23:02:42,378 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:42,378 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 23:02:42,389 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. completed. 2023-09-22 23:02:42,390 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,390 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. completed. 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:02:42,390 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 23:02:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:02:42,392 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 23:02:42,392 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:42,392 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,392 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 23:02:42,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,393 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,393 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 23:02:42,394 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:42,394 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 23:02:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37507,1695423720143': 2023-09-22 23:02:42,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-22 23:02:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:02:42,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-22 23:02:42,402 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-22 23:02:42,402 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:02:42,402 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:02:42,402 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,403 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:02:42,404 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,404 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,404 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,404 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,404 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,404 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,404 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,405 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,406 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,406 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,408 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,408 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,409 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,413 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,413 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,413 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,413 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-22 23:02:42,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,413 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,413 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,413 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,415 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:02:42,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,414 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,417 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,417 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,417 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,417 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,417 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,418 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,418 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,418 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,418 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 23:02:42,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,435 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:42,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 23:02:42,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:02:42,436 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:02:42,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-22 23:02:42,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,445 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 23:02:42,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695423762334Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695423762426 (+92 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695423762426Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695423762427 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695423762430 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695423762439 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695423762445 (+6 ms) 2023-09-22 23:02:42,450 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 23:02:42,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 116 msec 2023-09-22 23:02:42,636 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:42,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 23:02:42,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:02:42,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37507] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:02:42,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38937] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:02:42,645 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-22 23:02:42,645 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,646 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:02:42,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 23:02:42,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423762656 (current time:1695423762656). 2023-09-22 23:02:42,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:02:42,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x5a8a5e50 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:42,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37fd5926, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:42,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:42,670 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:42,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a8a5e50 to 127.0.0.1:57942 2023-09-22 23:02:42,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:42,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x63bd4594 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:02:42,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b4def6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:02:42,680 DEBUG [hconnection-0x36a4af4b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:42,683 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:42,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:02:42,690 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:02:42,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63bd4594 to 127.0.0.1:57942 2023-09-22 23:02:42,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:02:42,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 23:02:42,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:02:42,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 23:02:42,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 23:02:42,696 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 23:02:42,697 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695424362697 2023-09-22 23:02:42,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-22 23:02:42,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 23:02:42,699 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:02:42,699 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:02:42,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 23:02:42,700 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 23:02:42,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-22 23:02:42,703 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 23:02:42,703 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695424362703 2023-09-22 23:02:42,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-22 23:02:42,714 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-22 23:02:42,714 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:42,715 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-22 23:02:42,715 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-22 23:02:42,715 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,715 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,717 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,717 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,717 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,717 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,717 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,717 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,718 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,718 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:02:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 23:02:42,719 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 23:02:42,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 23:02:42,719 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 23:02:42,720 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 23:02:42,720 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:42,719 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:42,721 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 23:02:42,722 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 23:02:42,720 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:02:42,722 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 23:02:42,722 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 23:02:42,723 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 23:02:42,723 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 23:02:42,723 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 23:02:42,723 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 23:02:42,723 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 23:02:42,724 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,724 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,725 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:02:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-22 23:02:42,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d93cc63[Count = 1] remaining members to acquire global barrier 2023-09-22 23:02:42,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-22 23:02:42,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d93cc63[Count = 0] remaining members to acquire global barrier 2023-09-22 23:02:42,729 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-22 23:02:42,729 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,731 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,731 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,731 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 23:02:42,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:02:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,732 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 23:02:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:42,732 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:02:42,732 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,732 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. started... 2023-09-22 23:02:42,732 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,732 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:02:42,732 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. started... 2023-09-22 23:02:42,732 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:02:42,733 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8e9074ae79b3259bdb145cb42e5c0392 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-22 23:02:42,733 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2e22a84b24715a33227c61a22970a9b4 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-22 23:02:42,735 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 23:02:42,735 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:42,735 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 23:02:42,768 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092228cee497d89c440798dc52539152ebb0 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092228cee497d89c440798dc52539152ebb0 2023-09-22 23:02:42,770 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922a9f970fec04e4d339510f89a49531d1d to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9f970fec04e4d339510f89a49531d1d 2023-09-22 23:02:42,788 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/.tmp/cf/1b9d4bba1a6e4a6da5e61a375e3068de 2023-09-22 23:02:42,789 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/.tmp/cf/0cb5d82e7d454665926c6d666613e7bf 2023-09-22 23:02:42,794 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/.tmp/cf/1b9d4bba1a6e4a6da5e61a375e3068de as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf/1b9d4bba1a6e4a6da5e61a375e3068de 2023-09-22 23:02:42,795 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/.tmp/cf/0cb5d82e7d454665926c6d666613e7bf as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf/0cb5d82e7d454665926c6d666613e7bf 2023-09-22 23:02:42,799 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf/1b9d4bba1a6e4a6da5e61a375e3068de, entries=1, sequenceid=6, filesize=5.1 K 2023-09-22 23:02:42,800 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:42,800 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 2e22a84b24715a33227c61a22970a9b4 in 67ms, sequenceid=6, compaction requested=false 2023-09-22 23:02:42,800 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-22 23:02:42,801 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf/0cb5d82e7d454665926c6d666613e7bf, entries=49, sequenceid=6, filesize=13.0 K 2023-09-22 23:02:42,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 23:02:42,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:02:42,801 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2e22a84b24715a33227c61a22970a9b4: 2023-09-22 23:02:42,801 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 23:02:42,801 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:02:42,802 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:42,802 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf/1b9d4bba1a6e4a6da5e61a375e3068de] hfiles 2023-09-22 23:02:42,802 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf/1b9d4bba1a6e4a6da5e61a375e3068de for snapshot=snaptb0-testConsecutiveExports 2023-09-22 23:02:42,802 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 8e9074ae79b3259bdb145cb42e5c0392 in 69ms, sequenceid=6, compaction requested=false 2023-09-22 23:02:42,803 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9074ae79b3259bdb145cb42e5c0392: 2023-09-22 23:02:42,804 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 23:02:42,804 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:02:42,804 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf/0cb5d82e7d454665926c6d666613e7bf] hfiles 2023-09-22 23:02:42,804 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf/0cb5d82e7d454665926c6d666613e7bf for snapshot=snaptb0-testConsecutiveExports 2023-09-22 23:02:42,815 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. completed. 2023-09-22 23:02:42,815 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:02:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:02:42,816 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. completed. 2023-09-22 23:02:42,816 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 23:02:42,816 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:02:42,817 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,817 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 23:02:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,817 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:42,818 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 23:02:42,819 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,819 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 23:02:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,819 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 23:02:42,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37507,1695423720143': 2023-09-22 23:02:42,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-22 23:02:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:02:42,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-22 23:02:42,827 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-22 23:02:42,827 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:02:42,827 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:02:42,827 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-22 23:02:42,827 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:02:42,830 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,830 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:02:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:02:42,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,830 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:02:42,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,831 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,832 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:02:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:02:42,834 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 23:02:42,834 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,835 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,840 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,841 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,841 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,841 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,841 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,841 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,841 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,841 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,841 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:02:42,840 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:02:42,841 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-22 23:02:42,842 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:02:42,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,841 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,843 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:02:42,843 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,843 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:02:42,843 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:02:42,843 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,843 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,842 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-22 23:02:42,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:02:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:02:42,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 23:02:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:02:42,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:02:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:02:42,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9f970fec04e4d339510f89a49531d1d, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092228cee497d89c440798dc52539152ebb0] mob files 2023-09-22 23:02:42,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9f970fec04e4d339510f89a49531d1d 2023-09-22 23:02:42,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092228cee497d89c440798dc52539152ebb0 2023-09-22 23:02:42,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-22 23:02:42,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-22 23:02:42,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,883 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 23:02:42,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695423762698Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695423762855 (+157 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695423762855Loading Region manifests for snaptb0-testConsecutiveExports at 1695423762855Writing data manifest for snaptb0-testConsecutiveExports at 1695423762862 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695423762873 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695423762882 (+9 ms) 2023-09-22 23:02:42,885 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 23:02:42,887 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 187 msec 2023-09-22 23:02:43,002 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:02:43,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 23:02:43,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:02:43,004 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004 2023-09-22 23:02:43,004 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004, srcFsUri=hdfs://localhost:34671, srcDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:43,027 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:43,027 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7f27cd39, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 23:02:43,027 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0, snapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-22 23:02:43,037 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 23:02:43,052 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:43,053 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:43,054 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:43,054 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:43,941 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-1029074768635360261.jar 2023-09-22 23:02:43,942 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:43,942 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:44,008 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-6180593780183494832.jar 2023-09-22 23:02:44,009 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:44,009 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:44,010 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:44,010 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:44,010 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:44,011 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:44,011 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 23:02:44,011 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 23:02:44,012 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 23:02:44,012 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 23:02:44,012 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 23:02:44,013 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 23:02:44,013 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 23:02:44,014 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 23:02:44,014 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 23:02:44,015 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 23:02:44,015 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:44,016 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:44,016 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:44,016 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:44,017 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:44,017 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:44,018 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:44,383 WARN [Listener at jenkins-hbase4.apache.org/32797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 23:02:44,385 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-22 23:02:44,387 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-22 23:02:46,088 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:02:46,089 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:02:46,091 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0002_000001 (auth:SIMPLE) 2023-09-22 23:02:46,911 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0003_000001 (auth:SIMPLE) 2023-09-22 23:02:46,944 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 23:02:50,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0003_000001 (auth:SIMPLE) 2023-09-22 23:02:52,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0003_000001 (auth:SIMPLE) 2023-09-22 23:02:55,144 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0003_000001 (auth:SIMPLE) 2023-09-22 23:02:56,581 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 23:02:56,582 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 23:02:56,586 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-22 23:02:56,586 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 23:02:56,587 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 23:02:56,587 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 23:02:56,589 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 23:02:56,590 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 23:02:56,590 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c6f4238 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 23:02:56,590 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 23:02:56,590 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 23:02:56,591 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004, srcFsUri=hdfs://localhost:34671, srcDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:56,613 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:02:56,613 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3a640578, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 23:02:56,613 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0, snapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-22 23:02:56,624 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 23:02:56,637 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:56,637 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:56,638 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:56,638 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,513 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-2488498780707065634.jar 2023-09-22 23:02:57,513 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,514 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,580 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-5372046630543873921.jar 2023-09-22 23:02:57,580 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,580 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,581 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,581 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,582 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,582 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 23:02:57,582 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 23:02:57,583 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 23:02:57,583 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 23:02:57,583 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 23:02:57,584 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 23:02:57,584 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 23:02:57,585 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 23:02:57,585 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 23:02:57,585 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 23:02:57,586 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 23:02:57,586 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:57,587 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:57,587 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:57,587 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:57,588 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:02:57,588 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:57,589 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:02:57,946 WARN [Listener at jenkins-hbase4.apache.org/32797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 23:02:57,948 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-22 23:02:57,950 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-22 23:03:01,312 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:03:01,312 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:03:01,315 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0003_000001 (auth:SIMPLE) 2023-09-22 23:03:02,100 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0004_000001 (auth:SIMPLE) 2023-09-22 23:03:05,649 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0004_000001 (auth:SIMPLE) 2023-09-22 23:03:07,856 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0004_000001 (auth:SIMPLE) 2023-09-22 23:03:10,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0004_000001 (auth:SIMPLE) 2023-09-22 23:03:11,106 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 23:03:11,107 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 23:03:11,109 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-22 23:03:11,110 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 23:03:11,110 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 23:03:11,110 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 23:03:11,114 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 23:03:11,114 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 23:03:11,114 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c6f4238 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 23:03:11,114 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 23:03:11,114 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/local-export-1695423763004/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 23:03:11,126 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-22 23:03:11,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-22 23:03:11,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-22 23:03:11,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 23:03:11,131 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423791130"}]},"ts":"1695423791130"} 2023-09-22 23:03:11,132 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-22 23:03:11,134 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-22 23:03:11,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2e22a84b24715a33227c61a22970a9b4, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e9074ae79b3259bdb145cb42e5c0392, UNASSIGN}] 2023-09-22 23:03:11,136 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2e22a84b24715a33227c61a22970a9b4, UNASSIGN 2023-09-22 23:03:11,136 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e9074ae79b3259bdb145cb42e5c0392, UNASSIGN 2023-09-22 23:03:11,136 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=2e22a84b24715a33227c61a22970a9b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:11,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8e9074ae79b3259bdb145cb42e5c0392, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:11,137 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423791136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423791136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423791136"}]},"ts":"1695423791136"} 2023-09-22 23:03:11,137 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423791137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423791137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423791137"}]},"ts":"1695423791137"} 2023-09-22 23:03:11,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 2e22a84b24715a33227c61a22970a9b4, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:03:11,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 8e9074ae79b3259bdb145cb42e5c0392, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:11,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 23:03:11,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:03:11,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:03:11,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8e9074ae79b3259bdb145cb42e5c0392, disabling compactions & flushes 2023-09-22 23:03:11,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e22a84b24715a33227c61a22970a9b4, disabling compactions & flushes 2023-09-22 23:03:11,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:03:11,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:03:11,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:03:11,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:03:11,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. after waiting 0 ms 2023-09-22 23:03:11,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. after waiting 0 ms 2023-09-22 23:03:11,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:03:11,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:03:11,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:03:11,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:03:11,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:11,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:11,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4. 2023-09-22 23:03:11,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392. 2023-09-22 23:03:11,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e22a84b24715a33227c61a22970a9b4: 2023-09-22 23:03:11,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8e9074ae79b3259bdb145cb42e5c0392: 2023-09-22 23:03:11,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:03:11,304 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=2e22a84b24715a33227c61a22970a9b4, regionState=CLOSED 2023-09-22 23:03:11,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:03:11,305 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423791304"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423791304"}]},"ts":"1695423791304"} 2023-09-22 23:03:11,305 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8e9074ae79b3259bdb145cb42e5c0392, regionState=CLOSED 2023-09-22 23:03:11,305 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695423791305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423791305"}]},"ts":"1695423791305"} 2023-09-22 23:03:11,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-22 23:03:11,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 2e22a84b24715a33227c61a22970a9b4, server=jenkins-hbase4.apache.org,37507,1695423720143 in 168 msec 2023-09-22 23:03:11,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-22 23:03:11,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 8e9074ae79b3259bdb145cb42e5c0392, server=jenkins-hbase4.apache.org,38937,1695423720190 in 169 msec 2023-09-22 23:03:11,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2e22a84b24715a33227c61a22970a9b4, UNASSIGN in 174 msec 2023-09-22 23:03:11,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-22 23:03:11,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e9074ae79b3259bdb145cb42e5c0392, UNASSIGN in 175 msec 2023-09-22 23:03:11,311 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423791311"}]},"ts":"1695423791311"} 2023-09-22 23:03:11,313 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-22 23:03:11,315 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-22 23:03:11,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 189 msec 2023-09-22 23:03:11,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 23:03:11,432 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-22 23:03:11,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-22 23:03:11,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 23:03:11,436 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 23:03:11,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-22 23:03:11,437 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 23:03:11,440 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-22 23:03:11,444 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:03:11,444 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:03:11,446 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/recovered.edits] 2023-09-22 23:03:11,446 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/recovered.edits] 2023-09-22 23:03:11,450 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 23:03:11,450 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 23:03:11,450 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 23:03:11,450 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 23:03:11,451 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 23:03:11,451 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 23:03:11,451 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 23:03:11,451 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 23:03:11,452 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf/1b9d4bba1a6e4a6da5e61a375e3068de to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/cf/1b9d4bba1a6e4a6da5e61a375e3068de 2023-09-22 23:03:11,452 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf/0cb5d82e7d454665926c6d666613e7bf to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/cf/0cb5d82e7d454665926c6d666613e7bf 2023-09-22 23:03:11,452 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 23:03:11,452 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 23:03:11,452 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:11,452 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 23:03:11,452 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:11,452 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 23:03:11,452 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:11,452 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:11,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-22 23:03:11,456 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4/recovered.edits/9.seqid 2023-09-22 23:03:11,456 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392/recovered.edits/9.seqid 2023-09-22 23:03:11,456 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/2e22a84b24715a33227c61a22970a9b4 2023-09-22 23:03:11,457 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testConsecutiveExports/8e9074ae79b3259bdb145cb42e5c0392 2023-09-22 23:03:11,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-22 23:03:11,457 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-22 23:03:11,458 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-22 23:03:11,461 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9f970fec04e4d339510f89a49531d1d to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922a9f970fec04e4d339510f89a49531d1d 2023-09-22 23:03:11,463 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092228cee497d89c440798dc52539152ebb0 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092228cee497d89c440798dc52539152ebb0 2023-09-22 23:03:11,463 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-22 23:03:11,466 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 23:03:11,469 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-22 23:03:11,471 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-22 23:03:11,472 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 23:03:11,472 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-22 23:03:11,472 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423791472"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:11,472 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423791472"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:11,474 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 23:03:11,474 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2e22a84b24715a33227c61a22970a9b4, NAME => 'testtb-testConsecutiveExports,,1695423761673.2e22a84b24715a33227c61a22970a9b4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8e9074ae79b3259bdb145cb42e5c0392, NAME => 'testtb-testConsecutiveExports,1,1695423761673.8e9074ae79b3259bdb145cb42e5c0392.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 23:03:11,474 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-22 23:03:11,474 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695423791474"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:11,475 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-22 23:03:11,477 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 23:03:11,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 44 msec 2023-09-22 23:03:11,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-22 23:03:11,555 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-22 23:03:11,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-22 23:03:11,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-22 23:03:11,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-22 23:03:11,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-22 23:03:11,591 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=753 (was 766), OpenFileDescriptor=909 (was 941), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 196) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1312 (was 1544) 2023-09-22 23:03:11,591 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-22 23:03:11,609 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=753, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=168, AvailableMemoryMB=1312 2023-09-22 23:03:11,610 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-22 23:03:11,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 23:03:11,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:11,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:03:11,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-22 23:03:11,615 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:03:11,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 23:03:11,617 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,617 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,618 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3 empty. 2023-09-22 23:03:11,618 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6 empty. 2023-09-22 23:03:11,618 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,619 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,619 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-22 23:03:11,629 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-22 23:03:11,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ca482ed280025a07a98677023eed4c3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:03:11,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => db426386677d279f2171c33e38f8b5e6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing db426386677d279f2171c33e38f8b5e6, disabling compactions & flushes 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 7ca482ed280025a07a98677023eed4c3, disabling compactions & flushes 2023-09-22 23:03:11,638 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:11,638 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. after waiting 0 ms 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. after waiting 0 ms 2023-09-22 23:03:11,638 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 7ca482ed280025a07a98677023eed4c3: 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:11,638 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:11,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for db426386677d279f2171c33e38f8b5e6: 2023-09-22 23:03:11,640 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:03:11,641 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423791641"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423791641"}]},"ts":"1695423791641"} 2023-09-22 23:03:11,641 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423791641"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423791641"}]},"ts":"1695423791641"} 2023-09-22 23:03:11,647 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 23:03:11,648 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:03:11,648 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423791648"}]},"ts":"1695423791648"} 2023-09-22 23:03:11,649 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-22 23:03:11,654 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:03:11,655 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:03:11,655 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:03:11,655 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:03:11,655 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:03:11,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ca482ed280025a07a98677023eed4c3, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db426386677d279f2171c33e38f8b5e6, ASSIGN}] 2023-09-22 23:03:11,657 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db426386677d279f2171c33e38f8b5e6, ASSIGN 2023-09-22 23:03:11,657 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ca482ed280025a07a98677023eed4c3, ASSIGN 2023-09-22 23:03:11,657 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db426386677d279f2171c33e38f8b5e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40697,1695423720223; forceNewPlan=false, retain=false 2023-09-22 23:03:11,658 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ca482ed280025a07a98677023eed4c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38937,1695423720190; forceNewPlan=false, retain=false 2023-09-22 23:03:11,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 23:03:11,808 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 23:03:11,810 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=7ca482ed280025a07a98677023eed4c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:11,810 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=db426386677d279f2171c33e38f8b5e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:11,811 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423791810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423791810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423791810"}]},"ts":"1695423791810"} 2023-09-22 23:03:11,811 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423791810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423791810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423791810"}]},"ts":"1695423791810"} 2023-09-22 23:03:11,812 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure db426386677d279f2171c33e38f8b5e6, server=jenkins-hbase4.apache.org,40697,1695423720223}] 2023-09-22 23:03:11,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 7ca482ed280025a07a98677023eed4c3, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:11,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 23:03:11,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:11,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db426386677d279f2171c33e38f8b5e6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 23:03:11,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ca482ed280025a07a98677023eed4c3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. service=AccessControlService 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. service=AccessControlService 2023-09-22 23:03:11,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:11,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,972 INFO [StoreOpener-7ca482ed280025a07a98677023eed4c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,972 INFO [StoreOpener-db426386677d279f2171c33e38f8b5e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,973 DEBUG [StoreOpener-7ca482ed280025a07a98677023eed4c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf 2023-09-22 23:03:11,973 DEBUG [StoreOpener-db426386677d279f2171c33e38f8b5e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf 2023-09-22 23:03:11,973 DEBUG [StoreOpener-db426386677d279f2171c33e38f8b5e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf 2023-09-22 23:03:11,973 DEBUG [StoreOpener-7ca482ed280025a07a98677023eed4c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf 2023-09-22 23:03:11,975 INFO [StoreOpener-db426386677d279f2171c33e38f8b5e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db426386677d279f2171c33e38f8b5e6 columnFamilyName cf 2023-09-22 23:03:11,975 INFO [StoreOpener-7ca482ed280025a07a98677023eed4c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ca482ed280025a07a98677023eed4c3 columnFamilyName cf 2023-09-22 23:03:11,976 INFO [StoreOpener-db426386677d279f2171c33e38f8b5e6-1] regionserver.HStore(310): Store=db426386677d279f2171c33e38f8b5e6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:11,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:11,981 INFO [StoreOpener-7ca482ed280025a07a98677023eed4c3-1] regionserver.HStore(310): Store=7ca482ed280025a07a98677023eed4c3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:11,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:03:11,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db426386677d279f2171c33e38f8b5e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65616002, jitterRate=-0.0222453773021698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:11,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db426386677d279f2171c33e38f8b5e6: 2023-09-22 23:03:11,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6., pid=60, masterSystemTime=1695423791964 2023-09-22 23:03:11,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:11,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:11,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:11,988 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=db426386677d279f2171c33e38f8b5e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:11,988 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423791988"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423791988"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423791988"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423791988"}]},"ts":"1695423791988"} 2023-09-22 23:03:11,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:03:11,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ca482ed280025a07a98677023eed4c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73818439, jitterRate=0.09998045861721039}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:11,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ca482ed280025a07a98677023eed4c3: 2023-09-22 23:03:11,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3., pid=61, masterSystemTime=1695423791965 2023-09-22 23:03:11,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:11,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:11,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-22 23:03:11,992 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=7ca482ed280025a07a98677023eed4c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:11,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure db426386677d279f2171c33e38f8b5e6, server=jenkins-hbase4.apache.org,40697,1695423720223 in 178 msec 2023-09-22 23:03:11,992 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423791992"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423791992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423791992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423791992"}]},"ts":"1695423791992"} 2023-09-22 23:03:11,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db426386677d279f2171c33e38f8b5e6, ASSIGN in 337 msec 2023-09-22 23:03:11,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-22 23:03:11,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 7ca482ed280025a07a98677023eed4c3, server=jenkins-hbase4.apache.org,38937,1695423720190 in 181 msec 2023-09-22 23:03:11,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-22 23:03:11,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ca482ed280025a07a98677023eed4c3, ASSIGN in 340 msec 2023-09-22 23:03:11,998 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:03:11,998 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423791998"}]},"ts":"1695423791998"} 2023-09-22 23:03:11,999 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-22 23:03:12,001 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:03:12,001 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-22 23:03:12,003 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 23:03:12,005 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:12,005 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:12,005 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:12,005 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:12,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:12,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:12,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:12,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:12,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 396 msec 2023-09-22 23:03:12,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 23:03:12,218 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-22 23:03:12,221 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,221 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:12,223 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:03:12,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 23:03:12,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423792235 (current time:1695423792235). 2023-09-22 23:03:12,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:03:12,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x6c8448c4 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:12,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10f1139c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:12,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:12,246 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:12,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c8448c4 to 127.0.0.1:57942 2023-09-22 23:03:12,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:12,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x73f8422f to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:12,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d74f6fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:12,254 DEBUG [hconnection-0x25017f3d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:12,255 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:12,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:12,260 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:12,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73f8422f to 127.0.0.1:57942 2023-09-22 23:03:12,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:12,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 23:03:12,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:03:12,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 23:03:12,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 23:03:12,265 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 23:03:12,265 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695424392265 2023-09-22 23:03:12,265 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 23:03:12,267 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:03:12,267 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:03:12,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 23:03:12,268 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 23:03:12,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-22 23:03:12,270 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 23:03:12,270 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695424392270 2023-09-22 23:03:12,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,278 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-22 23:03:12,278 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:12,279 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-22 23:03:12,279 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-22 23:03:12,280 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,280 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,282 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,282 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,282 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,282 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,283 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,283 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,283 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,283 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:03:12,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,284 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 23:03:12,284 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 23:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,284 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:12,284 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 23:03:12,285 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 23:03:12,285 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 23:03:12,284 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:12,285 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 23:03:12,286 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 23:03:12,286 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 23:03:12,286 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 23:03:12,285 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:12,287 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 23:03:12,287 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 23:03:12,287 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 23:03:12,289 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,289 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,289 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,289 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,289 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:12,289 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,289 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,290 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,290 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,290 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:12,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,290 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:12,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 23:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5359b366[Count = 1] remaining members to acquire global barrier 2023-09-22 23:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 23:03:12,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5359b366[Count = 0] remaining members to acquire global barrier 2023-09-22 23:03:12,293 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-22 23:03:12,293 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,295 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,295 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,295 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 23:03:12,296 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:12,296 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:12,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,296 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. started... 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:12,296 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,296 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 23:03:12,296 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ca482ed280025a07a98677023eed4c3: 2023-09-22 23:03:12,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:03:12,296 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:12,296 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:12,296 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:12,297 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:12,297 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:03:12,297 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. started... 2023-09-22 23:03:12,298 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db426386677d279f2171c33e38f8b5e6: 2023-09-22 23:03:12,298 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,298 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:12,298 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:03:12,303 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 23:03:12,303 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:12,304 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 23:03:12,306 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. completed. 2023-09-22 23:03:12,306 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:12,306 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:12,306 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:12,306 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,307 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. completed. 2023-09-22 23:03:12,307 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 23:03:12,307 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:03:12,307 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:12,307 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:12,307 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:12,307 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,307 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 23:03:12,307 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:03:12,308 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 23:03:12,308 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:12,308 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 23:03:12,308 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,310 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 23:03:12,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,310 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:12,310 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,310 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 23:03:12,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:03:12,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-22 23:03:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40697,1695423720223': 2023-09-22 23:03:12,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-22 23:03:12,317 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-22 23:03:12,317 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:03:12,317 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:03:12,317 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,317 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:03:12,319 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,319 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,319 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,319 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,320 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,320 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,321 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,322 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,322 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,323 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,326 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:12,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,327 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,327 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,326 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,327 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:03:12,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,328 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,328 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,328 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,328 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,328 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,328 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,328 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,328 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 23:03:12,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-22 23:03:12,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,359 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695423792266Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695423792336 (+70 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695423792336Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695423792336Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695423792339 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695423792353 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695423792359 (+6 ms) 2023-09-22 23:03:12,362 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 23:03:12,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 96 msec 2023-09-22 23:03:12,367 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:12,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 23:03:12,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:03:12,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38937] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:03:12,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40697] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:03:12,374 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,374 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:12,374 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:03:12,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 23:03:12,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423792383 (current time:1695423792383). 2023-09-22 23:03:12,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:03:12,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x11c05e15 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:12,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c4e91ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:12,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:12,393 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:12,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11c05e15 to 127.0.0.1:57942 2023-09-22 23:03:12,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:12,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x68498005 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:12,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b6a5bef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:12,401 DEBUG [hconnection-0x33e24589-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:12,403 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:12,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:12,407 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:12,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68498005 to 127.0.0.1:57942 2023-09-22 23:03:12,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:12,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 23:03:12,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:03:12,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 23:03:12,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 23:03:12,412 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 23:03:12,413 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695424392413 2023-09-22 23:03:12,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 23:03:12,414 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:03:12,414 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:03:12,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 23:03:12,415 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 23:03:12,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-22 23:03:12,417 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 23:03:12,418 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695424392418 2023-09-22 23:03:12,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,426 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-22 23:03:12,426 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:12,427 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-22 23:03:12,427 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-22 23:03:12,427 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,428 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,429 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,429 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,429 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,429 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,430 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 23:03:12,431 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 23:03:12,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,431 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 23:03:12,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,431 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,431 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:03:12,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 23:03:12,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,431 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:12,431 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 23:03:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 23:03:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 23:03:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:12,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 23:03:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 23:03:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 23:03:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 23:03:12,432 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 23:03:12,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,434 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 23:03:12,434 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:12,434 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 23:03:12,434 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 23:03:12,434 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 23:03:12,436 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,436 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,436 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,438 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,438 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,438 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:12,438 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,438 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:12,438 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,438 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,438 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:12,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 23:03:12,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@196b3564[Count = 1] remaining members to acquire global barrier 2023-09-22 23:03:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 23:03:12,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@196b3564[Count = 0] remaining members to acquire global barrier 2023-09-22 23:03:12,442 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-22 23:03:12,442 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 23:03:12,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,443 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 23:03:12,443 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:12,443 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:12,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:12,443 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 23:03:12,443 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,443 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:03:12,443 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:03:12,443 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. started... 2023-09-22 23:03:12,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,443 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 23:03:12,443 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7ca482ed280025a07a98677023eed4c3 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-22 23:03:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:12,444 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:12,444 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:12,444 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. started... 2023-09-22 23:03:12,444 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2745): Flushing db426386677d279f2171c33e38f8b5e6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-22 23:03:12,445 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 23:03:12,445 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:12,445 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 23:03:12,465 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922cb5fb50b14de4ad5a57dbb355d0c5f4c to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230922cb5fb50b14de4ad5a57dbb355d0c5f4c 2023-09-22 23:03:12,466 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092208acb7d014b944f6a9bd5002ecd17845 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092208acb7d014b944f6a9bd5002ecd17845 2023-09-22 23:03:12,476 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/.tmp/cf/7573d16ca9af469f9831bd56da5fa21b 2023-09-22 23:03:12,476 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/.tmp/cf/593f05a88dca49ef8d58f5a5322c874e 2023-09-22 23:03:12,481 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/.tmp/cf/7573d16ca9af469f9831bd56da5fa21b as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf/7573d16ca9af469f9831bd56da5fa21b 2023-09-22 23:03:12,482 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/.tmp/cf/593f05a88dca49ef8d58f5a5322c874e as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf/593f05a88dca49ef8d58f5a5322c874e 2023-09-22 23:03:12,486 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf/7573d16ca9af469f9831bd56da5fa21b, entries=3, sequenceid=6, filesize=5.4 K 2023-09-22 23:03:12,486 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf/593f05a88dca49ef8d58f5a5322c874e, entries=47, sequenceid=6, filesize=13.5 K 2023-09-22 23:03:12,487 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7ca482ed280025a07a98677023eed4c3 in 44ms, sequenceid=6, compaction requested=false 2023-09-22 23:03:12,487 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-22 23:03:12,488 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ca482ed280025a07a98677023eed4c3: 2023-09-22 23:03:12,488 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,488 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:12,488 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf/7573d16ca9af469f9831bd56da5fa21b] hfiles 2023-09-22 23:03:12,488 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf/7573d16ca9af469f9831bd56da5fa21b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,488 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for db426386677d279f2171c33e38f8b5e6 in 44ms, sequenceid=6, compaction requested=false 2023-09-22 23:03:12,490 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db426386677d279f2171c33e38f8b5e6: 2023-09-22 23:03:12,490 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,490 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:12,490 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf/593f05a88dca49ef8d58f5a5322c874e] hfiles 2023-09-22 23:03:12,490 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf/593f05a88dca49ef8d58f5a5322c874e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,496 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. completed. 2023-09-22 23:03:12,496 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:12,496 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:12,496 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:12,496 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. completed. 2023-09-22 23:03:12,497 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:12,496 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,497 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:12,497 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:12,497 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,497 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 23:03:12,497 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:03:12,497 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 23:03:12,497 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:03:12,500 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 23:03:12,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:12,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 23:03:12,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,500 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 23:03:12,501 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:12,501 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 23:03:12,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:03:12,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-22 23:03:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40697,1695423720223': 2023-09-22 23:03:12,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-22 23:03:12,509 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-22 23:03:12,509 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:03:12,509 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:03:12,509 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,509 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:03:12,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:12,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:12,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,513 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:12,514 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,514 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:12,514 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,515 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 23:03:12,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:03:12,516 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:03:12,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:12,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,518 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:12,518 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,518 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,521 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:12,521 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,523 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,521 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:12,523 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,523 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:12,523 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:03:12,523 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:12,523 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,523 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,524 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092208acb7d014b944f6a9bd5002ecd17845, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230922cb5fb50b14de4ad5a57dbb355d0c5f4c] mob files 2023-09-22 23:03:12,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092208acb7d014b944f6a9bd5002ecd17845 2023-09-22 23:03:12,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230922cb5fb50b14de4ad5a57dbb355d0c5f4c 2023-09-22 23:03:12,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-22 23:03:12,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,558 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:12,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695423792413Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695423792531 (+118 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695423792531Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695423792531Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695423792535 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695423792549 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695423792557 (+8 ms) 2023-09-22 23:03:12,560 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 23:03:12,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 146 msec 2023-09-22 23:03:12,716 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:12,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 23:03:12,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:03:12,745 DEBUG [Listener at jenkins-hbase4.apache.org/32797] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 23:03:12,750 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 23:03:12,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37507] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 23:03:12,752 DEBUG [Listener at jenkins-hbase4.apache.org/32797] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 23:03:12,756 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 23:03:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38937] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 23:03:12,757 DEBUG [Listener at jenkins-hbase4.apache.org/32797] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 23:03:12,759 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 23:03:12,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40697] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 23:03:12,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-22 23:03:12,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:12,764 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:03:12,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-22 23:03:12,764 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:03:12,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 23:03:12,767 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:12,767 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:12,767 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1 empty. 2023-09-22 23:03:12,767 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709 empty. 2023-09-22 23:03:12,768 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:12,768 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:12,768 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-22 23:03:12,777 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-22 23:03:12,778 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f9997be870c112c4bf929c73840ef3c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:03:12,778 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0b06c25548d821a08ecc6394b5211709, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:03:12,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f9997be870c112c4bf929c73840ef3c1, disabling compactions & flushes 2023-09-22 23:03:12,786 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 0b06c25548d821a08ecc6394b5211709, disabling compactions & flushes 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. after waiting 0 ms 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:12,786 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:12,786 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f9997be870c112c4bf929c73840ef3c1: 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. after waiting 0 ms 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:12,786 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:12,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 0b06c25548d821a08ecc6394b5211709: 2023-09-22 23:03:12,788 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:03:12,789 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423792789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423792789"}]},"ts":"1695423792789"} 2023-09-22 23:03:12,789 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423792789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423792789"}]},"ts":"1695423792789"} 2023-09-22 23:03:12,791 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 23:03:12,792 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:03:12,792 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423792792"}]},"ts":"1695423792792"} 2023-09-22 23:03:12,793 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-22 23:03:12,798 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:03:12,799 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:03:12,799 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:03:12,799 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:03:12,799 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:03:12,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9997be870c112c4bf929c73840ef3c1, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b06c25548d821a08ecc6394b5211709, ASSIGN}] 2023-09-22 23:03:12,801 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b06c25548d821a08ecc6394b5211709, ASSIGN 2023-09-22 23:03:12,801 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9997be870c112c4bf929c73840ef3c1, ASSIGN 2023-09-22 23:03:12,802 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9997be870c112c4bf929c73840ef3c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37507,1695423720143; forceNewPlan=false, retain=false 2023-09-22 23:03:12,802 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b06c25548d821a08ecc6394b5211709, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38937,1695423720190; forceNewPlan=false, retain=false 2023-09-22 23:03:12,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 23:03:12,952 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 23:03:12,955 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0b06c25548d821a08ecc6394b5211709, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:12,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f9997be870c112c4bf929c73840ef3c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:12,955 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423792955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423792955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423792955"}]},"ts":"1695423792955"} 2023-09-22 23:03:12,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423792955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423792955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423792955"}]},"ts":"1695423792955"} 2023-09-22 23:03:12,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 0b06c25548d821a08ecc6394b5211709, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:12,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure f9997be870c112c4bf929c73840ef3c1, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:03:13,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 23:03:13,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:13,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:13,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b06c25548d821a08ecc6394b5211709, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.', STARTKEY => '2', ENDKEY => ''} 2023-09-22 23:03:13,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9997be870c112c4bf929c73840ef3c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.', STARTKEY => '', ENDKEY => '2'} 2023-09-22 23:03:13,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. service=AccessControlService 2023-09-22 23:03:13,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. service=AccessControlService 2023-09-22 23:03:13,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:13,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:13,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:13,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:13,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,114 INFO [StoreOpener-f9997be870c112c4bf929c73840ef3c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,114 INFO [StoreOpener-0b06c25548d821a08ecc6394b5211709-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,115 DEBUG [StoreOpener-f9997be870c112c4bf929c73840ef3c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf 2023-09-22 23:03:13,115 DEBUG [StoreOpener-f9997be870c112c4bf929c73840ef3c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf 2023-09-22 23:03:13,116 DEBUG [StoreOpener-0b06c25548d821a08ecc6394b5211709-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf 2023-09-22 23:03:13,116 DEBUG [StoreOpener-0b06c25548d821a08ecc6394b5211709-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf 2023-09-22 23:03:13,116 INFO [StoreOpener-f9997be870c112c4bf929c73840ef3c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9997be870c112c4bf929c73840ef3c1 columnFamilyName cf 2023-09-22 23:03:13,116 INFO [StoreOpener-0b06c25548d821a08ecc6394b5211709-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b06c25548d821a08ecc6394b5211709 columnFamilyName cf 2023-09-22 23:03:13,116 INFO [StoreOpener-f9997be870c112c4bf929c73840ef3c1-1] regionserver.HStore(310): Store=f9997be870c112c4bf929c73840ef3c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:13,117 INFO [StoreOpener-0b06c25548d821a08ecc6394b5211709-1] regionserver.HStore(310): Store=0b06c25548d821a08ecc6394b5211709/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:13,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:03:13,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:03:13,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9997be870c112c4bf929c73840ef3c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68301721, jitterRate=0.017774954438209534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:13,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b06c25548d821a08ecc6394b5211709; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67424218, jitterRate=0.004699140787124634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:13,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9997be870c112c4bf929c73840ef3c1: 2023-09-22 23:03:13,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b06c25548d821a08ecc6394b5211709: 2023-09-22 23:03:13,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709., pid=69, masterSystemTime=1695423793108 2023-09-22 23:03:13,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1., pid=70, masterSystemTime=1695423793109 2023-09-22 23:03:13,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:13,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:13,126 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0b06c25548d821a08ecc6394b5211709, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:13,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423793126"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423793126"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423793126"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423793126"}]},"ts":"1695423793126"} 2023-09-22 23:03:13,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:13,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:13,127 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f9997be870c112c4bf929c73840ef3c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:13,127 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423793127"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423793127"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423793127"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423793127"}]},"ts":"1695423793127"} 2023-09-22 23:03:13,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-22 23:03:13,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 0b06c25548d821a08ecc6394b5211709, server=jenkins-hbase4.apache.org,38937,1695423720190 in 171 msec 2023-09-22 23:03:13,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-22 23:03:13,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure f9997be870c112c4bf929c73840ef3c1, server=jenkins-hbase4.apache.org,37507,1695423720143 in 172 msec 2023-09-22 23:03:13,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b06c25548d821a08ecc6394b5211709, ASSIGN in 331 msec 2023-09-22 23:03:13,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-22 23:03:13,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9997be870c112c4bf929c73840ef3c1, ASSIGN in 332 msec 2023-09-22 23:03:13,133 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:03:13,134 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423793134"}]},"ts":"1695423793134"} 2023-09-22 23:03:13,135 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-22 23:03:13,138 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:03:13,138 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-22 23:03:13,140 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-22 23:03:13,142 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:13,142 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:13,142 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:13,142 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:13,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:13,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:13,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:13,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:13,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:13,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:13,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:13,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:13,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 382 msec 2023-09-22 23:03:13,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 23:03:13,368 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-22 23:03:13,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions f9997be870c112c4bf929c73840ef3c1, 0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f9997be870c112c4bf929c73840ef3c1, 0b06c25548d821a08ecc6394b5211709], force=true 2023-09-22 23:03:13,399 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f9997be870c112c4bf929c73840ef3c1, 0b06c25548d821a08ecc6394b5211709], force=true 2023-09-22 23:03:13,399 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f9997be870c112c4bf929c73840ef3c1, 0b06c25548d821a08ecc6394b5211709], force=true 2023-09-22 23:03:13,399 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f9997be870c112c4bf929c73840ef3c1, 0b06c25548d821a08ecc6394b5211709], force=true 2023-09-22 23:03:13,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 23:03:13,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9997be870c112c4bf929c73840ef3c1, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b06c25548d821a08ecc6394b5211709, UNASSIGN}] 2023-09-22 23:03:13,421 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9997be870c112c4bf929c73840ef3c1, UNASSIGN 2023-09-22 23:03:13,422 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b06c25548d821a08ecc6394b5211709, UNASSIGN 2023-09-22 23:03:13,422 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f9997be870c112c4bf929c73840ef3c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:13,422 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423793422"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423793422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423793422"}]},"ts":"1695423793422"} 2023-09-22 23:03:13,422 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0b06c25548d821a08ecc6394b5211709, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:13,422 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423793422"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423793422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423793422"}]},"ts":"1695423793422"} 2023-09-22 23:03:13,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure f9997be870c112c4bf929c73840ef3c1, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:03:13,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 0b06c25548d821a08ecc6394b5211709, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:13,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 23:03:13,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9997be870c112c4bf929c73840ef3c1, disabling compactions & flushes 2023-09-22 23:03:13,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:13,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:13,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. after waiting 0 ms 2023-09-22 23:03:13,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:13,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f9997be870c112c4bf929c73840ef3c1 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-22 23:03:13,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b06c25548d821a08ecc6394b5211709, disabling compactions & flushes 2023-09-22 23:03:13,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:13,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:13,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. after waiting 0 ms 2023-09-22 23:03:13,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:13,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0b06c25548d821a08ecc6394b5211709 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-22 23:03:13,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/.tmp/cf/a49fb056ee7e424f814aed071358653d 2023-09-22 23:03:13,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/.tmp/cf/947238ab634040309dec5ab7912eb629 2023-09-22 23:03:13,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/.tmp/cf/947238ab634040309dec5ab7912eb629 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf/947238ab634040309dec5ab7912eb629 2023-09-22 23:03:13,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/.tmp/cf/a49fb056ee7e424f814aed071358653d as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf/a49fb056ee7e424f814aed071358653d 2023-09-22 23:03:13,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf/947238ab634040309dec5ab7912eb629, entries=1, sequenceid=5, filesize=4.7 K 2023-09-22 23:03:13,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf/a49fb056ee7e424f814aed071358653d, entries=1, sequenceid=5, filesize=4.7 K 2023-09-22 23:03:13,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f9997be870c112c4bf929c73840ef3c1 in 24ms, sequenceid=5, compaction requested=false 2023-09-22 23:03:13,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 23:03:13,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0b06c25548d821a08ecc6394b5211709 in 22ms, sequenceid=5, compaction requested=false 2023-09-22 23:03:13,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 23:03:13,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-22 23:03:13,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-22 23:03:13,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:13,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709. 2023-09-22 23:03:13,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:13,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b06c25548d821a08ecc6394b5211709: 2023-09-22 23:03:13,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1. 2023-09-22 23:03:13,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9997be870c112c4bf929c73840ef3c1: 2023-09-22 23:03:13,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:13,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f9997be870c112c4bf929c73840ef3c1, regionState=CLOSED 2023-09-22 23:03:13,613 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423793613"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423793613"}]},"ts":"1695423793613"} 2023-09-22 23:03:13,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:13,614 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0b06c25548d821a08ecc6394b5211709, regionState=CLOSED 2023-09-22 23:03:13,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695423793614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423793614"}]},"ts":"1695423793614"} 2023-09-22 23:03:13,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-22 23:03:13,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure f9997be870c112c4bf929c73840ef3c1, server=jenkins-hbase4.apache.org,37507,1695423720143 in 191 msec 2023-09-22 23:03:13,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-22 23:03:13,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 0b06c25548d821a08ecc6394b5211709, server=jenkins-hbase4.apache.org,38937,1695423720190 in 191 msec 2023-09-22 23:03:13,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9997be870c112c4bf929c73840ef3c1, UNASSIGN in 199 msec 2023-09-22 23:03:13,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-22 23:03:13,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b06c25548d821a08ecc6394b5211709, UNASSIGN in 197 msec 2023-09-22 23:03:13,666 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-22 23:03:13,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792761.f9997be870c112c4bf929c73840ef3c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:13,668 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695423792761.0b06c25548d821a08ecc6394b5211709.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:13,668 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:13,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 23:03:13,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3108d6cfe5675966cf8236b6cc72380f, ASSIGN}] 2023-09-22 23:03:13,716 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3108d6cfe5675966cf8236b6cc72380f, ASSIGN 2023-09-22 23:03:13,717 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3108d6cfe5675966cf8236b6cc72380f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37507,1695423720143; forceNewPlan=false, retain=false 2023-09-22 23:03:13,867 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 23:03:13,869 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3108d6cfe5675966cf8236b6cc72380f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:13,869 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695423793869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423793869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423793869"}]},"ts":"1695423793869"} 2023-09-22 23:03:13,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 3108d6cfe5675966cf8236b6cc72380f, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:03:14,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 23:03:14,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:14,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3108d6cfe5675966cf8236b6cc72380f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.', STARTKEY => '', ENDKEY => ''} 2023-09-22 23:03:14,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. service=AccessControlService 2023-09-22 23:03:14,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:14,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:14,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:14,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:14,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:14,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/.regioninfo 2023-09-22 23:03:14,036 INFO [StoreOpener-3108d6cfe5675966cf8236b6cc72380f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:14,036 DEBUG [StoreOpener-3108d6cfe5675966cf8236b6cc72380f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf 2023-09-22 23:03:14,036 DEBUG [StoreOpener-3108d6cfe5675966cf8236b6cc72380f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf 2023-09-22 23:03:14,037 INFO [StoreOpener-3108d6cfe5675966cf8236b6cc72380f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3108d6cfe5675966cf8236b6cc72380f columnFamilyName cf 2023-09-22 23:03:14,065 DEBUG [StoreOpener-3108d6cfe5675966cf8236b6cc72380f-1] regionserver.HStore(539): loaded hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/947238ab634040309dec5ab7912eb629.f9997be870c112c4bf929c73840ef3c1->hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf/947238ab634040309dec5ab7912eb629-top 2023-09-22 23:03:14,071 DEBUG [StoreOpener-3108d6cfe5675966cf8236b6cc72380f-1] regionserver.HStore(539): loaded hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/a49fb056ee7e424f814aed071358653d.0b06c25548d821a08ecc6394b5211709->hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf/a49fb056ee7e424f814aed071358653d-top 2023-09-22 23:03:14,072 INFO [StoreOpener-3108d6cfe5675966cf8236b6cc72380f-1] regionserver.HStore(310): Store=3108d6cfe5675966cf8236b6cc72380f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:14,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:14,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:14,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:14,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3108d6cfe5675966cf8236b6cc72380f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71787958, jitterRate=0.0697239339351654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:14,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3108d6cfe5675966cf8236b6cc72380f: 2023-09-22 23:03:14,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f., pid=77, masterSystemTime=1695423794022 2023-09-22 23:03:14,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.,because compaction is disabled. 2023-09-22 23:03:14,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:14,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:14,080 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3108d6cfe5675966cf8236b6cc72380f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,081 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695423794080"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423794080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423794080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423794080"}]},"ts":"1695423794080"} 2023-09-22 23:03:14,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-22 23:03:14,084 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 3108d6cfe5675966cf8236b6cc72380f, server=jenkins-hbase4.apache.org,37507,1695423720143 in 211 msec 2023-09-22 23:03:14,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-22 23:03:14,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3108d6cfe5675966cf8236b6cc72380f, ASSIGN in 368 msec 2023-09-22 23:03:14,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f9997be870c112c4bf929c73840ef3c1, 0b06c25548d821a08ecc6394b5211709], force=true in 693 msec 2023-09-22 23:03:14,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 23:03:14,507 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-22 23:03:14,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 23:03:14,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423794508 (current time:1695423794508). 2023-09-22 23:03:14,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:03:14,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x2313c9a5 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:14,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1203b996, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:14,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:14,520 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:14,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2313c9a5 to 127.0.0.1:57942 2023-09-22 23:03:14,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:14,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x524987cd to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:14,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6faa32c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:14,528 DEBUG [hconnection-0x606ae9aa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:14,531 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:14,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:14,536 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:14,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x524987cd to 127.0.0.1:57942 2023-09-22 23:03:14,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:14,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-22 23:03:14,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:03:14,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 23:03:14,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 23:03:14,541 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 23:03:14,542 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695424394542 2023-09-22 23:03:14,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 23:03:14,542 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,545 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:03:14,545 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:03:14,546 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 23:03:14,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 23:03:14,547 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-22 23:03:14,548 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 23:03:14,549 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695424394549 2023-09-22 23:03:14,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,557 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 23:03:14,557 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:14,558 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-22 23:03:14,558 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-22 23:03:14,558 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,558 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,560 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:14,560 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:14,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:14,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:14,560 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,560 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:14,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,561 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,561 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:03:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 23:03:14,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,562 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 23:03:14,562 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:14,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,565 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 23:03:14,566 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 23:03:14,566 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:14,566 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 23:03:14,567 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 23:03:14,567 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 23:03:14,566 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 23:03:14,567 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 23:03:14,567 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:14,567 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 23:03:14,568 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 23:03:14,568 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 23:03:14,568 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 23:03:14,569 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,570 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,570 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,570 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:14,570 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,571 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:14,571 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,571 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:14,571 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,571 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:14,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:14,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:14,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:14,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-22 23:03:14,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55f3f224[Count = 0] remaining members to acquire global barrier 2023-09-22 23:03:14,573 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-22 23:03:14,573 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,574 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,574 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,574 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,575 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 23:03:14,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,575 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,575 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:03:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,575 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 23:03:14,575 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 23:03:14,575 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 23:03:14,575 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:03:14,575 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 23:03:14,575 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:03:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 23:03:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 23:03:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 23:03:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 23:03:14,582 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:14,582 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:14,582 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:14,582 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. started... 2023-09-22 23:03:14,583 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3108d6cfe5675966cf8236b6cc72380f: 2023-09-22 23:03:14,583 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,584 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:14,584 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/947238ab634040309dec5ab7912eb629.f9997be870c112c4bf929c73840ef3c1->hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf/947238ab634040309dec5ab7912eb629-top, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/a49fb056ee7e424f814aed071358653d.0b06c25548d821a08ecc6394b5211709->hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf/a49fb056ee7e424f814aed071358653d-top] hfiles 2023-09-22 23:03:14,584 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/947238ab634040309dec5ab7912eb629.f9997be870c112c4bf929c73840ef3c1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,584 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/a49fb056ee7e424f814aed071358653d.0b06c25548d821a08ecc6394b5211709 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,591 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. completed. 2023-09-22 23:03:14,591 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:14,591 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:14,591 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:14,591 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,591 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 23:03:14,591 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:03:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 23:03:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:14,597 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 23:03:14,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:14,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:14,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37507,1695423720143': 2023-09-22 23:03:14,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-22 23:03:14,600 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-22 23:03:14,600 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:03:14,600 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:03:14,600 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,600 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:03:14,602 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:14,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:14,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:14,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:14,602 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:14,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:14,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:14,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:14,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:14,603 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:14,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:14,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:14,603 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,603 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:14,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,605 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:14,605 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,606 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,608 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,609 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,609 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:14,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,609 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:14,609 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:14,609 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:14,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:14,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:14,609 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:14,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:14,609 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:14,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:14,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:14,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:14,609 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:14,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:14,609 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:14,610 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,610 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,610 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:14,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:14,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:14,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:14,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:14,610 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,610 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:14,610 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:14,610 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,610 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-22 23:03:14,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,628 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695423794542Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695423794609 (+67 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695423794609Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695423794613 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695423794619 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695423794628 (+9 ms) 2023-09-22 23:03:14,631 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 23:03:14,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 86 msec 2023-09-22 23:03:14,645 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:14,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-22 23:03:14,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:03:14,646 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646 2023-09-22 23:03:14,647 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34671, tgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646, rawTgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646, srcFsUri=hdfs://localhost:34671, srcDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:03:14,669 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:03:14,669 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-530087528_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,669 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0, snapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-22 23:03:14,677 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:14,698 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:14,698 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:14,699 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:14,699 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,569 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-1216805773000958426.jar 2023-09-22 23:03:15,570 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,570 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,639 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-881608394456873923.jar 2023-09-22 23:03:15,639 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,640 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,640 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,640 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,641 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,641 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:15,642 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 23:03:15,642 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 23:03:15,642 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 23:03:15,643 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 23:03:15,643 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 23:03:15,643 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 23:03:15,644 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 23:03:15,644 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 23:03:15,644 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 23:03:15,645 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 23:03:15,646 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:15,646 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:15,647 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:15,647 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:15,647 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:15,648 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:15,648 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:16,018 WARN [Listener at jenkins-hbase4.apache.org/32797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 23:03:16,020 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-22 23:03:16,022 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-22 23:03:16,221 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:03:16,221 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:03:16,224 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0004_000001 (auth:SIMPLE) 2023-09-22 23:03:16,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0005_000001 (auth:SIMPLE) 2023-09-22 23:03:16,880 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 23:03:20,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0005_000001 (auth:SIMPLE) 2023-09-22 23:03:22,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0005_000001 (auth:SIMPLE) 2023-09-22 23:03:25,061 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0005_000001 (auth:SIMPLE) 2023-09-22 23:03:26,384 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 23:03:26,387 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 23:03:26,395 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,395 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 23:03:26,396 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 23:03:26,396 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,396 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-22 23:03:26,396 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-22 23:03:26,396 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,397 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-22 23:03:26,397 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423794646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-22 23:03:26,403 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 23:03:26,407 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423806407"}]},"ts":"1695423806407"} 2023-09-22 23:03:26,408 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-22 23:03:26,410 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-22 23:03:26,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3108d6cfe5675966cf8236b6cc72380f, UNASSIGN}] 2023-09-22 23:03:26,412 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3108d6cfe5675966cf8236b6cc72380f, UNASSIGN 2023-09-22 23:03:26,413 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3108d6cfe5675966cf8236b6cc72380f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:26,413 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695423806413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423806413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423806413"}]},"ts":"1695423806413"} 2023-09-22 23:03:26,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 3108d6cfe5675966cf8236b6cc72380f, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:03:26,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 23:03:26,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:26,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3108d6cfe5675966cf8236b6cc72380f, disabling compactions & flushes 2023-09-22 23:03:26,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:26,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:26,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. after waiting 0 ms 2023-09-22 23:03:26,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:26,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-22 23:03:26,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:26,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f. 2023-09-22 23:03:26,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3108d6cfe5675966cf8236b6cc72380f: 2023-09-22 23:03:26,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:26,580 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3108d6cfe5675966cf8236b6cc72380f, regionState=CLOSED 2023-09-22 23:03:26,580 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695423806580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423806580"}]},"ts":"1695423806580"} 2023-09-22 23:03:26,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-22 23:03:26,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 3108d6cfe5675966cf8236b6cc72380f, server=jenkins-hbase4.apache.org,37507,1695423720143 in 167 msec 2023-09-22 23:03:26,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-22 23:03:26,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3108d6cfe5675966cf8236b6cc72380f, UNASSIGN in 172 msec 2023-09-22 23:03:26,585 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423806585"}]},"ts":"1695423806585"} 2023-09-22 23:03:26,586 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-22 23:03:26,587 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-22 23:03:26,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 184 msec 2023-09-22 23:03:26,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 23:03:26,709 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-22 23:03:26,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,713 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,713 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,715 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,717 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:26,718 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:26,717 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:26,718 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,718 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,718 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,718 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 23:03:26,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 23:03:26,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 23:03:26,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 23:03:26,720 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/recovered.edits] 2023-09-22 23:03:26,720 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/recovered.edits] 2023-09-22 23:03:26,720 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,720 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:26,720 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,720 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:26,720 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,720 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,720 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:26,720 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:26,721 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/recovered.edits] 2023-09-22 23:03:26,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-22 23:03:26,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:26,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:26,723 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:26,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:26,725 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf/a49fb056ee7e424f814aed071358653d to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/cf/a49fb056ee7e424f814aed071358653d 2023-09-22 23:03:26,726 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/947238ab634040309dec5ab7912eb629.f9997be870c112c4bf929c73840ef3c1 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/947238ab634040309dec5ab7912eb629.f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:26,727 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/a49fb056ee7e424f814aed071358653d.0b06c25548d821a08ecc6394b5211709 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/cf/a49fb056ee7e424f814aed071358653d.0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:26,729 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/recovered.edits/8.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709/recovered.edits/8.seqid 2023-09-22 23:03:26,729 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf/947238ab634040309dec5ab7912eb629 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/cf/947238ab634040309dec5ab7912eb629 2023-09-22 23:03:26,729 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b06c25548d821a08ecc6394b5211709 2023-09-22 23:03:26,731 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/recovered.edits/12.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f/recovered.edits/12.seqid 2023-09-22 23:03:26,731 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3108d6cfe5675966cf8236b6cc72380f 2023-09-22 23:03:26,732 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/recovered.edits/8.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1/recovered.edits/8.seqid 2023-09-22 23:03:26,732 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9997be870c112c4bf929c73840ef3c1 2023-09-22 23:03:26,732 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-22 23:03:26,734 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,736 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-22 23:03:26,742 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-22 23:03:26,743 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,743 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-22 23:03:26,743 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423806743"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:26,745 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-22 23:03:26,745 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3108d6cfe5675966cf8236b6cc72380f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695423792762.3108d6cfe5675966cf8236b6cc72380f.', STARTKEY => '', ENDKEY => ''}] 2023-09-22 23:03:26,745 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-22 23:03:26,745 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695423806745"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:26,746 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-22 23:03:26,748 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:26,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 38 msec 2023-09-22 23:03:26,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-22 23:03:26,823 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-22 23:03:26,823 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:26,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:26,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:26,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 23:03:26,828 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423806828"}]},"ts":"1695423806828"} 2023-09-22 23:03:26,829 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-22 23:03:26,831 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-22 23:03:26,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ca482ed280025a07a98677023eed4c3, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db426386677d279f2171c33e38f8b5e6, UNASSIGN}] 2023-09-22 23:03:26,833 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ca482ed280025a07a98677023eed4c3, UNASSIGN 2023-09-22 23:03:26,833 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db426386677d279f2171c33e38f8b5e6, UNASSIGN 2023-09-22 23:03:26,834 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=7ca482ed280025a07a98677023eed4c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:26,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=db426386677d279f2171c33e38f8b5e6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:26,834 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423806834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423806834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423806834"}]},"ts":"1695423806834"} 2023-09-22 23:03:26,834 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423806834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423806834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423806834"}]},"ts":"1695423806834"} 2023-09-22 23:03:26,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 7ca482ed280025a07a98677023eed4c3, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:26,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure db426386677d279f2171c33e38f8b5e6, server=jenkins-hbase4.apache.org,40697,1695423720223}] 2023-09-22 23:03:26,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 23:03:26,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:26,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:26,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ca482ed280025a07a98677023eed4c3, disabling compactions & flushes 2023-09-22 23:03:26,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db426386677d279f2171c33e38f8b5e6, disabling compactions & flushes 2023-09-22 23:03:26,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:26,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:26,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:26,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:26,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. after waiting 0 ms 2023-09-22 23:03:26,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:26,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. after waiting 0 ms 2023-09-22 23:03:26,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:27,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:03:27,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:03:27,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:27,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:27,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6. 2023-09-22 23:03:27,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3. 2023-09-22 23:03:27,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db426386677d279f2171c33e38f8b5e6: 2023-09-22 23:03:27,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ca482ed280025a07a98677023eed4c3: 2023-09-22 23:03:27,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:27,007 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=db426386677d279f2171c33e38f8b5e6, regionState=CLOSED 2023-09-22 23:03:27,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:27,007 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423807006"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423807006"}]},"ts":"1695423807006"} 2023-09-22 23:03:27,007 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=7ca482ed280025a07a98677023eed4c3, regionState=CLOSED 2023-09-22 23:03:27,007 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695423807007"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423807007"}]},"ts":"1695423807007"} 2023-09-22 23:03:27,009 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-22 23:03:27,010 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure db426386677d279f2171c33e38f8b5e6, server=jenkins-hbase4.apache.org,40697,1695423720223 in 172 msec 2023-09-22 23:03:27,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-22 23:03:27,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 7ca482ed280025a07a98677023eed4c3, server=jenkins-hbase4.apache.org,38937,1695423720190 in 174 msec 2023-09-22 23:03:27,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db426386677d279f2171c33e38f8b5e6, UNASSIGN in 179 msec 2023-09-22 23:03:27,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-22 23:03:27,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ca482ed280025a07a98677023eed4c3, UNASSIGN in 179 msec 2023-09-22 23:03:27,012 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423807012"}]},"ts":"1695423807012"} 2023-09-22 23:03:27,013 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-22 23:03:27,016 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-22 23:03:27,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 193 msec 2023-09-22 23:03:27,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 23:03:27,130 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-22 23:03:27,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,133 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,134 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,135 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,138 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:27,138 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:27,139 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,139 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,139 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,139 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 23:03:27,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 23:03:27,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 23:03:27,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 23:03:27,140 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/recovered.edits] 2023-09-22 23:03:27,140 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/recovered.edits] 2023-09-22 23:03:27,140 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,140 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,140 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:27,140 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,140 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,141 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:27,140 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:27,141 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:27,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-22 23:03:27,144 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf/593f05a88dca49ef8d58f5a5322c874e to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/cf/593f05a88dca49ef8d58f5a5322c874e 2023-09-22 23:03:27,144 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf/7573d16ca9af469f9831bd56da5fa21b to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/cf/7573d16ca9af469f9831bd56da5fa21b 2023-09-22 23:03:27,147 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6/recovered.edits/9.seqid 2023-09-22 23:03:27,147 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3/recovered.edits/9.seqid 2023-09-22 23:03:27,147 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db426386677d279f2171c33e38f8b5e6 2023-09-22 23:03:27,147 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ca482ed280025a07a98677023eed4c3 2023-09-22 23:03:27,147 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-22 23:03:27,148 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-22 23:03:27,149 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-22 23:03:27,151 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092208acb7d014b944f6a9bd5002ecd17845 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092208acb7d014b944f6a9bd5002ecd17845 2023-09-22 23:03:27,153 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230922cb5fb50b14de4ad5a57dbb355d0c5f4c to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230922cb5fb50b14de4ad5a57dbb355d0c5f4c 2023-09-22 23:03:27,153 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-22 23:03:27,155 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,157 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-22 23:03:27,158 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-22 23:03:27,159 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,159 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-22 23:03:27,159 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423807159"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:27,159 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423807159"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:27,161 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 23:03:27,161 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7ca482ed280025a07a98677023eed4c3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695423791611.7ca482ed280025a07a98677023eed4c3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => db426386677d279f2171c33e38f8b5e6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695423791611.db426386677d279f2171c33e38f8b5e6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 23:03:27,161 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-22 23:03:27,161 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695423807161"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:27,162 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-22 23:03:27,165 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,166 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-22 23:03:27,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-22 23:03:27,243 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-22 23:03:27,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-22 23:03:27,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-22 23:03:27,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 23:03:27,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-22 23:03:27,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 23:03:27,283 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 753) Potentially hanging thread: hconnection-0x15efe84-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:37062 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:57026 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1629725449_1 at /127.0.0.1:55304 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1629725449_1 at /127.0.0.1:56912 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:59360 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3958 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x15efe84-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:39073 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=240 (was 250), ProcessCount=168 (was 168), AvailableMemoryMB=1178 (was 1312) 2023-09-22 23:03:27,283 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-22 23:03:27,302 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=240, ProcessCount=168, AvailableMemoryMB=1177 2023-09-22 23:03:27,302 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-22 23:03:27,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 23:03:27,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 23:03:27,306 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:03:27,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-22 23:03:27,307 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:03:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 23:03:27,309 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,309 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,309 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae empty. 2023-09-22 23:03:27,309 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d empty. 2023-09-22 23:03:27,310 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,310 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-22 23:03:27,319 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-22 23:03:27,320 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2769a9b3c114195456aaee967fd2eaae, NAME => 'testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:03:27,320 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b10541fe55ef24fa3b825f3a6633a50d, NAME => 'testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:03:27,327 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:27,327 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2769a9b3c114195456aaee967fd2eaae, disabling compactions & flushes 2023-09-22 23:03:27,327 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:27,328 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b10541fe55ef24fa3b825f3a6633a50d, disabling compactions & flushes 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,328 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. after waiting 0 ms 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. after waiting 0 ms 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:27,328 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,328 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2769a9b3c114195456aaee967fd2eaae: 2023-09-22 23:03:27,328 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b10541fe55ef24fa3b825f3a6633a50d: 2023-09-22 23:03:27,330 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:03:27,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423807331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423807331"}]},"ts":"1695423807331"} 2023-09-22 23:03:27,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423807331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423807331"}]},"ts":"1695423807331"} 2023-09-22 23:03:27,333 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 23:03:27,334 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:03:27,334 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423807334"}]},"ts":"1695423807334"} 2023-09-22 23:03:27,335 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-22 23:03:27,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:03:27,339 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:03:27,339 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:03:27,339 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:03:27,339 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:03:27,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2769a9b3c114195456aaee967fd2eaae, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b10541fe55ef24fa3b825f3a6633a50d, ASSIGN}] 2023-09-22 23:03:27,342 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2769a9b3c114195456aaee967fd2eaae, ASSIGN 2023-09-22 23:03:27,342 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b10541fe55ef24fa3b825f3a6633a50d, ASSIGN 2023-09-22 23:03:27,342 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b10541fe55ef24fa3b825f3a6633a50d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38937,1695423720190; forceNewPlan=false, retain=false 2023-09-22 23:03:27,342 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2769a9b3c114195456aaee967fd2eaae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37507,1695423720143; forceNewPlan=false, retain=false 2023-09-22 23:03:27,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 23:03:27,493 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 23:03:27,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b10541fe55ef24fa3b825f3a6633a50d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,495 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2769a9b3c114195456aaee967fd2eaae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423807495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423807495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423807495"}]},"ts":"1695423807495"} 2023-09-22 23:03:27,495 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423807495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423807495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423807495"}]},"ts":"1695423807495"} 2023-09-22 23:03:27,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure b10541fe55ef24fa3b825f3a6633a50d, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:27,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 2769a9b3c114195456aaee967fd2eaae, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:03:27,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 23:03:27,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:27,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b10541fe55ef24fa3b825f3a6633a50d, NAME => 'testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 23:03:27,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2769a9b3c114195456aaee967fd2eaae, NAME => 'testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 23:03:27,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. service=AccessControlService 2023-09-22 23:03:27,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. service=AccessControlService 2023-09-22 23:03:27,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:27,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:27,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:27,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:27,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,654 INFO [StoreOpener-2769a9b3c114195456aaee967fd2eaae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,654 INFO [StoreOpener-b10541fe55ef24fa3b825f3a6633a50d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,655 DEBUG [StoreOpener-2769a9b3c114195456aaee967fd2eaae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf 2023-09-22 23:03:27,655 DEBUG [StoreOpener-b10541fe55ef24fa3b825f3a6633a50d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf 2023-09-22 23:03:27,656 DEBUG [StoreOpener-b10541fe55ef24fa3b825f3a6633a50d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf 2023-09-22 23:03:27,656 DEBUG [StoreOpener-2769a9b3c114195456aaee967fd2eaae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf 2023-09-22 23:03:27,656 INFO [StoreOpener-b10541fe55ef24fa3b825f3a6633a50d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b10541fe55ef24fa3b825f3a6633a50d columnFamilyName cf 2023-09-22 23:03:27,656 INFO [StoreOpener-2769a9b3c114195456aaee967fd2eaae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2769a9b3c114195456aaee967fd2eaae columnFamilyName cf 2023-09-22 23:03:27,657 INFO [StoreOpener-2769a9b3c114195456aaee967fd2eaae-1] regionserver.HStore(310): Store=2769a9b3c114195456aaee967fd2eaae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:27,657 INFO [StoreOpener-b10541fe55ef24fa3b825f3a6633a50d-1] regionserver.HStore(310): Store=b10541fe55ef24fa3b825f3a6633a50d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:27,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:27,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:27,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:03:27,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:03:27,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b10541fe55ef24fa3b825f3a6633a50d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75087671, jitterRate=0.11889348924160004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:27,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b10541fe55ef24fa3b825f3a6633a50d: 2023-09-22 23:03:27,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2769a9b3c114195456aaee967fd2eaae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67192913, jitterRate=0.0012524276971817017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2769a9b3c114195456aaee967fd2eaae: 2023-09-22 23:03:27,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d., pid=93, masterSystemTime=1695423807648 2023-09-22 23:03:27,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae., pid=94, masterSystemTime=1695423807649 2023-09-22 23:03:27,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:27,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:27,667 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b10541fe55ef24fa3b825f3a6633a50d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,667 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423807667"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423807667"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423807667"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423807667"}]},"ts":"1695423807667"} 2023-09-22 23:03:27,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,668 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2769a9b3c114195456aaee967fd2eaae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,668 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423807668"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423807668"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423807668"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423807668"}]},"ts":"1695423807668"} 2023-09-22 23:03:27,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-22 23:03:27,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure b10541fe55ef24fa3b825f3a6633a50d, server=jenkins-hbase4.apache.org,38937,1695423720190 in 172 msec 2023-09-22 23:03:27,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-22 23:03:27,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 2769a9b3c114195456aaee967fd2eaae, server=jenkins-hbase4.apache.org,37507,1695423720143 in 172 msec 2023-09-22 23:03:27,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b10541fe55ef24fa3b825f3a6633a50d, ASSIGN in 332 msec 2023-09-22 23:03:27,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-22 23:03:27,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2769a9b3c114195456aaee967fd2eaae, ASSIGN in 333 msec 2023-09-22 23:03:27,674 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:03:27,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423807674"}]},"ts":"1695423807674"} 2023-09-22 23:03:27,675 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-22 23:03:27,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:03:27,678 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-22 23:03:27,680 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 23:03:27,682 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:27,682 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:27,682 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:27,682 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:27,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:27,684 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:27,684 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:27,684 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:27,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 380 msec 2023-09-22 23:03:27,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 23:03:27,911 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-22 23:03:27,913 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-22 23:03:27,913 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,914 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:03:27,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:03:27,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423807924 (current time:1695423807924). 2023-09-22 23:03:27,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:03:27,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x3f657c6c to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:27,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a35d62e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:27,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:27,936 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:27,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f657c6c to 127.0.0.1:57942 2023-09-22 23:03:27,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:27,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x10eea6e3 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:27,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fc3e8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:27,945 DEBUG [hconnection-0x601c0c99-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:27,947 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:27,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:27,951 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:27,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10eea6e3 to 127.0.0.1:57942 2023-09-22 23:03:27,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:27,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 23:03:27,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:03:27,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:03:27,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:03:27,955 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:03:27,956 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695424407956 2023-09-22 23:03:27,956 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-22 23:03:27,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:03:27,957 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:03:27,957 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:03:27,958 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:03:27,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 23:03:27,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-22 23:03:27,962 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 23:03:27,963 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695424407963 2023-09-22 23:03:27,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,971 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-22 23:03:27,971 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:27,972 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-22 23:03:27,972 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-22 23:03:27,972 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,973 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,978 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:27,978 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:27,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:27,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:27,978 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,978 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:27,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:27,979 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,979 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,979 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,979 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 23:03:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 23:03:27,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:27,981 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 23:03:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:27,981 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:27,982 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 23:03:27,983 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 23:03:27,983 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 23:03:27,981 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 23:03:27,983 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 23:03:27,983 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 23:03:27,983 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 23:03:27,983 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 23:03:27,983 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 23:03:27,985 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,985 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,985 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:27,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:27,989 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,989 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,989 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:27,989 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,989 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,989 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:27,989 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,989 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:27,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 23:03:27,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b0dc2d[Count = 1] remaining members to acquire global barrier 2023-09-22 23:03:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:27,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 23:03:27,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b0dc2d[Count = 0] remaining members to acquire global barrier 2023-09-22 23:03:27,994 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 23:03:27,994 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,995 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,995 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,995 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,995 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:03:27,996 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:27,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:03:27,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 23:03:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:27,996 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:03:27,996 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. started... 2023-09-22 23:03:27,996 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:27,996 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:03:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:03:27,996 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2769a9b3c114195456aaee967fd2eaae: 2023-09-22 23:03:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:27,997 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:27,997 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,997 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:27,997 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:27,997 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. started... 2023-09-22 23:03:27,997 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:03:27,998 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b10541fe55ef24fa3b825f3a6633a50d: 2023-09-22 23:03:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 23:03:27,998 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:27,998 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:27,999 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 23:03:28,000 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:03:28,006 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. completed. 2023-09-22 23:03:28,006 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:28,006 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:03:28,007 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. completed. 2023-09-22 23:03:28,007 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 23:03:28,007 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:03:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 23:03:28,008 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:28,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 23:03:28,010 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 23:03:28,010 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,010 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:28,010 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 23:03:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37507,1695423720143': 2023-09-22 23:03:28,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 23:03:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:03:28,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 23:03:28,016 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-22 23:03:28,016 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:03:28,016 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:03:28,016 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,016 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:03:28,018 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,018 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:28,018 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,018 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:28,018 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,019 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,020 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:28,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:28,021 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,022 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,022 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,025 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,025 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,025 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,025 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,026 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:28,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,026 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,026 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,025 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,026 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-22 23:03:28,027 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,027 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:03:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,028 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,028 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,028 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,028 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,028 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,028 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,028 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 23:03:28,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-22 23:03:28,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,053 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695423807956Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695423808035 (+79 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695423808035Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695423808035Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695423808038 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695423808047 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695423808052 (+5 ms) 2023-09-22 23:03:28,056 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 23:03:28,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 99 msec 2023-09-22 23:03:28,058 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:28,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 23:03:28,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:03:28,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37507] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:03:28,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38937] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:03:28,064 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-22 23:03:28,064 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:28,064 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:03:28,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:03:28,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423808073 (current time:1695423808073). 2023-09-22 23:03:28,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:03:28,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x30f5a282 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:28,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@308d08c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:28,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:28,088 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:28,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30f5a282 to 127.0.0.1:57942 2023-09-22 23:03:28,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:28,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x363d95b8 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:28,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bc1c04f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:28,097 DEBUG [hconnection-0x73d20ef6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:28,098 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:28,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:28,104 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:28,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x363d95b8 to 127.0.0.1:57942 2023-09-22 23:03:28,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:28,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 23:03:28,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:03:28,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:03:28,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:03:28,109 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:03:28,110 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695424408110 2023-09-22 23:03:28,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 23:03:28,110 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-22 23:03:28,111 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:03:28,111 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:03:28,112 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 23:03:28,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 23:03:28,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-22 23:03:28,114 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 23:03:28,115 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695424408115 2023-09-22 23:03:28,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,129 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-22 23:03:28,129 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:28,130 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-22 23:03:28,130 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-22 23:03:28,130 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,130 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,132 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,132 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,132 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,132 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,132 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,132 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,133 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,133 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 23:03:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 23:03:28,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 23:03:28,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 23:03:28,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 23:03:28,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 23:03:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 23:03:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 23:03:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 23:03:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 23:03:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:28,136 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 23:03:28,140 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 23:03:28,140 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 23:03:28,140 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 23:03:28,140 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 23:03:28,140 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 23:03:28,142 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,143 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,143 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:28,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:28,145 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:28,146 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,146 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:28,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:28,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78ec811e[Count = 1] remaining members to acquire global barrier 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:28,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 23:03:28,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78ec811e[Count = 0] remaining members to acquire global barrier 2023-09-22 23:03:28,149 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 23:03:28,149 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:03:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:03:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 23:03:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 23:03:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:03:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:28,154 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:28,154 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. started... 2023-09-22 23:03:28,154 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:28,154 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. started... 2023-09-22 23:03:28,154 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,154 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:03:28,154 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2769a9b3c114195456aaee967fd2eaae 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-22 23:03:28,154 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b10541fe55ef24fa3b825f3a6633a50d 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-22 23:03:28,156 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 23:03:28,156 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:28,156 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 23:03:28,177 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922fce5f97b11754f02bd4614ca1e5d07f7 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922fce5f97b11754f02bd4614ca1e5d07f7 2023-09-22 23:03:28,179 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922d7b5e63ec9c84249bea7ee18238a0413 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922d7b5e63ec9c84249bea7ee18238a0413 2023-09-22 23:03:28,185 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/.tmp/cf/f64851607b49413f82e3890096b13f25 2023-09-22 23:03:28,187 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/.tmp/cf/bb60778b9b514e0b91673de251baaeba 2023-09-22 23:03:28,190 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/.tmp/cf/f64851607b49413f82e3890096b13f25 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf/f64851607b49413f82e3890096b13f25 2023-09-22 23:03:28,192 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/.tmp/cf/bb60778b9b514e0b91673de251baaeba as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf/bb60778b9b514e0b91673de251baaeba 2023-09-22 23:03:28,196 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf/f64851607b49413f82e3890096b13f25, entries=6, sequenceid=6, filesize=5.9 K 2023-09-22 23:03:28,196 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf/bb60778b9b514e0b91673de251baaeba, entries=44, sequenceid=6, filesize=12.6 K 2023-09-22 23:03:28,197 INFO [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 2769a9b3c114195456aaee967fd2eaae in 43ms, sequenceid=6, compaction requested=false 2023-09-22 23:03:28,197 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-22 23:03:28,197 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for b10541fe55ef24fa3b825f3a6633a50d in 43ms, sequenceid=6, compaction requested=false 2023-09-22 23:03:28,197 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-22 23:03:28,200 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2769a9b3c114195456aaee967fd2eaae: 2023-09-22 23:03:28,200 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b10541fe55ef24fa3b825f3a6633a50d: 2023-09-22 23:03:28,200 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,200 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,201 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:28,201 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:28,201 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf/f64851607b49413f82e3890096b13f25] hfiles 2023-09-22 23:03:28,201 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf/bb60778b9b514e0b91673de251baaeba] hfiles 2023-09-22 23:03:28,201 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf/bb60778b9b514e0b91673de251baaeba for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,201 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf/f64851607b49413f82e3890096b13f25 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,210 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. completed. 2023-09-22 23:03:28,210 DEBUG [rs(jenkins-hbase4.apache.org,37507,1695423720143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:28,210 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. completed. 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,210 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 23:03:28,210 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:03:28,211 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:28,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 23:03:28,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:03:28,213 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:03:28,213 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 23:03:28,213 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,213 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:28,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,213 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 23:03:28,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:28,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:28,215 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,215 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 23:03:28,215 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:28,215 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 23:03:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37507,1695423720143': 2023-09-22 23:03:28,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 23:03:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:03:28,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 23:03:28,221 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-22 23:03:28,222 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:03:28,222 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:03:28,222 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,222 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:03:28,223 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,223 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:28,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,223 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,223 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,223 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,224 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,224 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,224 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,225 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,225 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:28,227 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,227 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,227 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-22 23:03:28,230 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:28,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,230 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:28,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:28,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:03:28,232 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,232 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:28,232 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:28,232 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,232 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922d7b5e63ec9c84249bea7ee18238a0413, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922fce5f97b11754f02bd4614ca1e5d07f7] mob files 2023-09-22 23:03:28,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922d7b5e63ec9c84249bea7ee18238a0413 2023-09-22 23:03:28,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922fce5f97b11754f02bd4614ca1e5d07f7 2023-09-22 23:03:28,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,257 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-22 23:03:28,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,257 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695423808110Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695423808240 (+130 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695423808240Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695423808240Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695423808244 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695423808250 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695423808257 (+7 ms) 2023-09-22 23:03:28,259 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 23:03:28,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 148 msec 2023-09-22 23:03:28,413 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:28,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 23:03:28,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:03:28,414 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414 2023-09-22 23:03:28,414 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34671, tgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414, rawTgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414, srcFsUri=hdfs://localhost:34671, srcDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:03:28,436 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:03:28,436 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2032684893_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,436 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0, snapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-22 23:03:28,441 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:28,456 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:28,456 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:28,456 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:28,457 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,325 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-4852144026915330430.jar 2023-09-22 23:03:29,325 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,326 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,392 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-5264834789249340972.jar 2023-09-22 23:03:29,392 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,392 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,393 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,393 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,393 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,394 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:29,394 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 23:03:29,394 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 23:03:29,395 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 23:03:29,395 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 23:03:29,395 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 23:03:29,396 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 23:03:29,396 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 23:03:29,396 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 23:03:29,397 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 23:03:29,397 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 23:03:29,398 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:29,398 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:29,399 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:29,399 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:29,399 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:29,400 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:29,400 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:29,770 WARN [Listener at jenkins-hbase4.apache.org/32797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 23:03:29,772 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-22 23:03:31,227 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:03:31,227 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:03:31,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0005_000001 (auth:SIMPLE) 2023-09-22 23:03:32,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0006_000001 (auth:SIMPLE) 2023-09-22 23:03:32,168 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 23:03:35,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0006_000001 (auth:SIMPLE) 2023-09-22 23:03:38,105 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 23:03:38,106 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 23:03:38,111 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:38,111 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 23:03:38,112 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 23:03:38,112 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:38,112 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-22 23:03:38,112 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-22 23:03:38,112 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:38,113 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-22 23:03:38,113 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423808414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-22 23:03:38,118 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 23:03:38,123 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423818123"}]},"ts":"1695423818123"} 2023-09-22 23:03:38,124 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-22 23:03:38,126 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-22 23:03:38,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2769a9b3c114195456aaee967fd2eaae, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b10541fe55ef24fa3b825f3a6633a50d, UNASSIGN}] 2023-09-22 23:03:38,131 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2769a9b3c114195456aaee967fd2eaae, UNASSIGN 2023-09-22 23:03:38,131 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b10541fe55ef24fa3b825f3a6633a50d, UNASSIGN 2023-09-22 23:03:38,132 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2769a9b3c114195456aaee967fd2eaae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:38,132 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b10541fe55ef24fa3b825f3a6633a50d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:38,132 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423818132"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423818132"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423818132"}]},"ts":"1695423818132"} 2023-09-22 23:03:38,132 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423818132"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423818132"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423818132"}]},"ts":"1695423818132"} 2023-09-22 23:03:38,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 2769a9b3c114195456aaee967fd2eaae, server=jenkins-hbase4.apache.org,37507,1695423720143}] 2023-09-22 23:03:38,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure b10541fe55ef24fa3b825f3a6633a50d, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:38,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 23:03:38,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:38,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:38,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b10541fe55ef24fa3b825f3a6633a50d, disabling compactions & flushes 2023-09-22 23:03:38,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2769a9b3c114195456aaee967fd2eaae, disabling compactions & flushes 2023-09-22 23:03:38,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:38,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:38,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:38,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. after waiting 0 ms 2023-09-22 23:03:38,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:38,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:38,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. after waiting 0 ms 2023-09-22 23:03:38,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:38,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:03:38,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:38,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d. 2023-09-22 23:03:38,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:03:38,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b10541fe55ef24fa3b825f3a6633a50d: 2023-09-22 23:03:38,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:38,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae. 2023-09-22 23:03:38,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2769a9b3c114195456aaee967fd2eaae: 2023-09-22 23:03:38,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:38,303 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b10541fe55ef24fa3b825f3a6633a50d, regionState=CLOSED 2023-09-22 23:03:38,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:38,303 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423818303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423818303"}]},"ts":"1695423818303"} 2023-09-22 23:03:38,304 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2769a9b3c114195456aaee967fd2eaae, regionState=CLOSED 2023-09-22 23:03:38,304 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695423818304"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423818304"}]},"ts":"1695423818304"} 2023-09-22 23:03:38,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-22 23:03:38,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure b10541fe55ef24fa3b825f3a6633a50d, server=jenkins-hbase4.apache.org,38937,1695423720190 in 170 msec 2023-09-22 23:03:38,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-22 23:03:38,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 2769a9b3c114195456aaee967fd2eaae, server=jenkins-hbase4.apache.org,37507,1695423720143 in 172 msec 2023-09-22 23:03:38,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b10541fe55ef24fa3b825f3a6633a50d, UNASSIGN in 179 msec 2023-09-22 23:03:38,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-22 23:03:38,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2769a9b3c114195456aaee967fd2eaae, UNASSIGN in 180 msec 2023-09-22 23:03:38,309 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423818309"}]},"ts":"1695423818309"} 2023-09-22 23:03:38,310 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-22 23:03:38,312 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-22 23:03:38,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 194 msec 2023-09-22 23:03:38,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 23:03:38,425 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-22 23:03:38,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,429 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,430 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,431 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,434 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:38,434 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:38,435 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,435 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,435 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,435 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 23:03:38,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 23:03:38,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 23:03:38,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 23:03:38,436 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/recovered.edits] 2023-09-22 23:03:38,436 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/recovered.edits] 2023-09-22 23:03:38,436 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,436 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,436 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,437 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:38,437 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,437 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:38,437 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:38,437 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:38,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-22 23:03:38,439 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf/f64851607b49413f82e3890096b13f25 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/cf/f64851607b49413f82e3890096b13f25 2023-09-22 23:03:38,439 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf/bb60778b9b514e0b91673de251baaeba to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/cf/bb60778b9b514e0b91673de251baaeba 2023-09-22 23:03:38,442 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae/recovered.edits/9.seqid 2023-09-22 23:03:38,442 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d/recovered.edits/9.seqid 2023-09-22 23:03:38,442 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/2769a9b3c114195456aaee967fd2eaae 2023-09-22 23:03:38,442 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testEmptyExportFileSystemState/b10541fe55ef24fa3b825f3a6633a50d 2023-09-22 23:03:38,442 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-22 23:03:38,443 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-22 23:03:38,443 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-22 23:03:38,446 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922d7b5e63ec9c84249bea7ee18238a0413 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922d7b5e63ec9c84249bea7ee18238a0413 2023-09-22 23:03:38,447 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922fce5f97b11754f02bd4614ca1e5d07f7 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922fce5f97b11754f02bd4614ca1e5d07f7 2023-09-22 23:03:38,447 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-22 23:03:38,449 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,451 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-22 23:03:38,453 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-22 23:03:38,453 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,453 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-22 23:03:38,454 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423818453"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:38,454 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423818453"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:38,455 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 23:03:38,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2769a9b3c114195456aaee967fd2eaae, NAME => 'testtb-testEmptyExportFileSystemState,,1695423807303.2769a9b3c114195456aaee967fd2eaae.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b10541fe55ef24fa3b825f3a6633a50d, NAME => 'testtb-testEmptyExportFileSystemState,1,1695423807303.b10541fe55ef24fa3b825f3a6633a50d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 23:03:38,455 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-22 23:03:38,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695423818455"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:38,457 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-22 23:03:38,459 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 23:03:38,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 33 msec 2023-09-22 23:03:38,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-22 23:03:38,539 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-22 23:03:38,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-22 23:03:38,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:38,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-22 23:03:38,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-22 23:03:38,573 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 762) Potentially hanging thread: hconnection-0x15efe84-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-530257742_1 at /127.0.0.1:37514 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:37855 from appattempt_1695423726499_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:55660 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:58194 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-530257742_1 at /127.0.0.1:58180 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_745818982_17 at /127.0.0.1:36632 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x15efe84-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4729 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:40549 from appattempt_1695423726499_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:40037 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=928 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 240), ProcessCount=168 (was 168), AvailableMemoryMB=1101 (was 1177) 2023-09-22 23:03:38,573 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-22 23:03:38,592 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=168, AvailableMemoryMB=1100 2023-09-22 23:03:38,592 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-22 23:03:38,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 23:03:38,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:38,597 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 23:03:38,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-22 23:03:38,598 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 23:03:38,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 23:03:38,600 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,600 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,601 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc empty. 2023-09-22 23:03:38,601 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc empty. 2023-09-22 23:03:38,601 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,601 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,601 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-22 23:03:38,610 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-22 23:03:38,611 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d84015244b5c9bb32ab2de0b0eb0bfc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:03:38,612 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0f63c4dc63828bc419284bcc22342ecc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp 2023-09-22 23:03:38,619 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:38,619 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:38,619 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4d84015244b5c9bb32ab2de0b0eb0bfc, disabling compactions & flushes 2023-09-22 23:03:38,619 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 0f63c4dc63828bc419284bcc22342ecc, disabling compactions & flushes 2023-09-22 23:03:38,620 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:38,620 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:38,620 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:38,620 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. after waiting 0 ms 2023-09-22 23:03:38,620 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:38,620 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:38,620 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. after waiting 0 ms 2023-09-22 23:03:38,620 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:38,620 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:38,620 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:38,620 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4d84015244b5c9bb32ab2de0b0eb0bfc: 2023-09-22 23:03:38,620 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 0f63c4dc63828bc419284bcc22342ecc: 2023-09-22 23:03:38,622 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 23:03:38,623 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423818623"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423818623"}]},"ts":"1695423818623"} 2023-09-22 23:03:38,623 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423818623"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423818623"}]},"ts":"1695423818623"} 2023-09-22 23:03:38,625 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 23:03:38,625 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 23:03:38,625 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423818625"}]},"ts":"1695423818625"} 2023-09-22 23:03:38,626 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-22 23:03:38,630 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 23:03:38,631 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 23:03:38,631 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 23:03:38,631 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 23:03:38,631 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 23:03:38,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d84015244b5c9bb32ab2de0b0eb0bfc, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f63c4dc63828bc419284bcc22342ecc, ASSIGN}] 2023-09-22 23:03:38,634 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f63c4dc63828bc419284bcc22342ecc, ASSIGN 2023-09-22 23:03:38,634 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d84015244b5c9bb32ab2de0b0eb0bfc, ASSIGN 2023-09-22 23:03:38,634 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f63c4dc63828bc419284bcc22342ecc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40697,1695423720223; forceNewPlan=false, retain=false 2023-09-22 23:03:38,634 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d84015244b5c9bb32ab2de0b0eb0bfc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38937,1695423720190; forceNewPlan=false, retain=false 2023-09-22 23:03:38,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 23:03:38,784 INFO [jenkins-hbase4:46029] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 23:03:38,787 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0f63c4dc63828bc419284bcc22342ecc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:38,787 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4d84015244b5c9bb32ab2de0b0eb0bfc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:38,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423818787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423818787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423818787"}]},"ts":"1695423818787"} 2023-09-22 23:03:38,787 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423818787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423818787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423818787"}]},"ts":"1695423818787"} 2023-09-22 23:03:38,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 0f63c4dc63828bc419284bcc22342ecc, server=jenkins-hbase4.apache.org,40697,1695423720223}] 2023-09-22 23:03:38,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 4d84015244b5c9bb32ab2de0b0eb0bfc, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:38,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 23:03:38,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:38,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:38,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f63c4dc63828bc419284bcc22342ecc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d84015244b5c9bb32ab2de0b0eb0bfc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. service=AccessControlService 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. service=AccessControlService 2023-09-22 23:03:38,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:38,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,945 INFO [StoreOpener-0f63c4dc63828bc419284bcc22342ecc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,945 INFO [StoreOpener-4d84015244b5c9bb32ab2de0b0eb0bfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,947 DEBUG [StoreOpener-0f63c4dc63828bc419284bcc22342ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf 2023-09-22 23:03:38,947 DEBUG [StoreOpener-0f63c4dc63828bc419284bcc22342ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf 2023-09-22 23:03:38,947 DEBUG [StoreOpener-4d84015244b5c9bb32ab2de0b0eb0bfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf 2023-09-22 23:03:38,947 DEBUG [StoreOpener-4d84015244b5c9bb32ab2de0b0eb0bfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf 2023-09-22 23:03:38,947 INFO [StoreOpener-0f63c4dc63828bc419284bcc22342ecc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f63c4dc63828bc419284bcc22342ecc columnFamilyName cf 2023-09-22 23:03:38,947 INFO [StoreOpener-4d84015244b5c9bb32ab2de0b0eb0bfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d84015244b5c9bb32ab2de0b0eb0bfc columnFamilyName cf 2023-09-22 23:03:38,948 INFO [StoreOpener-4d84015244b5c9bb32ab2de0b0eb0bfc-1] regionserver.HStore(310): Store=4d84015244b5c9bb32ab2de0b0eb0bfc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:38,948 INFO [StoreOpener-0f63c4dc63828bc419284bcc22342ecc-1] regionserver.HStore(310): Store=0f63c4dc63828bc419284bcc22342ecc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 23:03:38,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:38,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:38,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:03:38,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 23:03:38,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d84015244b5c9bb32ab2de0b0eb0bfc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60240954, jitterRate=-0.10233983397483826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:38,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f63c4dc63828bc419284bcc22342ecc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62972367, jitterRate=-0.06163860857486725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 23:03:38,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d84015244b5c9bb32ab2de0b0eb0bfc: 2023-09-22 23:03:38,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f63c4dc63828bc419284bcc22342ecc: 2023-09-22 23:03:38,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc., pid=109, masterSystemTime=1695423818941 2023-09-22 23:03:38,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc., pid=108, masterSystemTime=1695423818940 2023-09-22 23:03:38,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:38,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:38,957 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4d84015244b5c9bb32ab2de0b0eb0bfc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:38,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:38,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:38,957 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423818957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423818957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423818957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423818957"}]},"ts":"1695423818957"} 2023-09-22 23:03:38,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0f63c4dc63828bc419284bcc22342ecc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:38,958 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423818957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695423818957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695423818957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695423818957"}]},"ts":"1695423818957"} 2023-09-22 23:03:38,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-22 23:03:38,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 4d84015244b5c9bb32ab2de0b0eb0bfc, server=jenkins-hbase4.apache.org,38937,1695423720190 in 169 msec 2023-09-22 23:03:38,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-22 23:03:38,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 0f63c4dc63828bc419284bcc22342ecc, server=jenkins-hbase4.apache.org,40697,1695423720223 in 170 msec 2023-09-22 23:03:38,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d84015244b5c9bb32ab2de0b0eb0bfc, ASSIGN in 329 msec 2023-09-22 23:03:38,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-22 23:03:38,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f63c4dc63828bc419284bcc22342ecc, ASSIGN in 329 msec 2023-09-22 23:03:38,962 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 23:03:38,962 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423818962"}]},"ts":"1695423818962"} 2023-09-22 23:03:38,963 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-22 23:03:38,965 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 23:03:38,966 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-22 23:03:38,967 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 23:03:38,969 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:38,969 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:38,969 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:38,969 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:38,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:38,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:38,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:38,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 23:03:38,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 377 msec 2023-09-22 23:03:39,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 23:03:39,201 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-22 23:03:39,203 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,204 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:39,205 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:03:39,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 23:03:39,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423819215 (current time:1695423819215). 2023-09-22 23:03:39,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:03:39,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x2a890424 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:39,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67092f3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:39,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:39,228 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:39,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a890424 to 127.0.0.1:57942 2023-09-22 23:03:39,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:39,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x17ad5a44 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:39,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7567d4b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:39,236 DEBUG [hconnection-0x5b397df5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:39,238 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:39,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:39,244 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:39,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17ad5a44 to 127.0.0.1:57942 2023-09-22 23:03:39,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:39,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 23:03:39,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:03:39,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 23:03:39,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 23:03:39,248 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 23:03:39,249 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695424419249 2023-09-22 23:03:39,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 23:03:39,250 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:03:39,250 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:03:39,251 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 23:03:39,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 23:03:39,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-22 23:03:39,253 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 23:03:39,253 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695424419253 2023-09-22 23:03:39,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,264 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-22 23:03:39,265 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:39,266 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-22 23:03:39,266 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-22 23:03:39,266 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,266 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,268 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,268 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,268 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,268 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,269 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,269 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,269 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 23:03:39,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 23:03:39,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 23:03:39,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,270 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 23:03:39,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,270 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 23:03:39,270 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 23:03:39,270 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:39,270 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:39,270 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:39,271 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 23:03:39,272 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 23:03:39,272 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 23:03:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 23:03:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 23:03:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 23:03:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 23:03:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 23:03:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 23:03:39,280 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,280 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:39,281 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,281 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 23:03:39,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@386c5b72[Count = 1] remaining members to acquire global barrier 2023-09-22 23:03:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 23:03:39,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@386c5b72[Count = 0] remaining members to acquire global barrier 2023-09-22 23:03:39,283 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-22 23:03:39,284 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 23:03:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,285 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,285 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 23:03:39,285 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:39,285 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:39,285 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:03:39,285 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 23:03:39,285 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:39,285 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:39,285 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. started... 2023-09-22 23:03:39,285 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:39,285 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:39,286 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. started... 2023-09-22 23:03:39,285 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 23:03:39,287 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:03:39,287 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f63c4dc63828bc419284bcc22342ecc: 2023-09-22 23:03:39,287 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d84015244b5c9bb32ab2de0b0eb0bfc: 2023-09-22 23:03:39,287 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,287 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,287 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:39,287 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:39,287 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:03:39,287 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 23:03:39,288 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 23:03:39,288 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:39,288 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 23:03:39,299 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. completed. 2023-09-22 23:03:39,299 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:39,299 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:39,299 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:39,299 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,299 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 23:03:39,299 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:03:39,301 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. completed. 2023-09-22 23:03:39,301 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:39,301 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:39,302 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:39,302 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,302 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 23:03:39,302 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:03:39,302 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,302 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 23:03:39,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,302 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:39,302 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 23:03:39,304 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 23:03:39,304 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:39,304 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 23:03:39,304 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40697,1695423720223': 2023-09-22 23:03:39,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-22 23:03:39,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:03:39,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-22 23:03:39,313 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-22 23:03:39,313 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:03:39,313 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:03:39,313 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,313 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:03:39,314 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,315 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,315 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,315 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,316 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,316 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,318 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,319 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,319 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,322 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,322 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,322 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,322 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,322 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,322 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:39,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,322 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,322 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,322 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,324 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:03:39,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,324 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,324 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,325 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,325 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,325 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,325 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,325 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,325 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 23:03:39,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,350 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:39,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 23:03:39,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:03:39,351 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:03:39,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-22 23:03:39,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,356 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695423819249Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695423819341 (+92 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695423819341Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695423819341Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695423819344 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695423819351 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695423819356 (+5 ms) 2023-09-22 23:03:39,359 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 23:03:39,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 109 msec 2023-09-22 23:03:39,552 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:39,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 23:03:39,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:03:39,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38937] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:03:39,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40697] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 23:03:39,558 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,558 DEBUG [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:39,558 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 23:03:39,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 23:03:39,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695423819567 (current time:1695423819567). 2023-09-22 23:03:39,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 23:03:39,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x2c6f8543 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:39,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c2983ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:39,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:39,576 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:39,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c6f8543 to 127.0.0.1:57942 2023-09-22 23:03:39,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:39,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(139): Connect 0x5175a3d0 to 127.0.0.1:57942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 23:03:39,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1606120, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 23:03:39,584 DEBUG [hconnection-0x71a6b411-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:39,590 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:39,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 23:03:39,595 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 23:03:39,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5175a3d0 to 127.0.0.1:57942 2023-09-22 23:03:39,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:03:39,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 23:03:39,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 23:03:39,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 23:03:39,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 23:03:39,599 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 23:03:39,600 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695424419600 2023-09-22 23:03:39,600 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 23:03:39,601 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 23:03:39,601 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 23:03:39,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 23:03:39,602 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 23:03:39,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-22 23:03:39,604 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 23:03:39,605 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695424419605 2023-09-22 23:03:39,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,620 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-22 23:03:39,620 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:39,621 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-22 23:03:39,621 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-22 23:03:39,621 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,621 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,623 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,624 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,624 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,624 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,624 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,624 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,625 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,625 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,625 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,625 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:39,625 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 23:03:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 23:03:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 23:03:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37507,1695423720143' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 23:03:39,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 23:03:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 23:03:39,628 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 23:03:39,629 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 23:03:39,629 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 23:03:39,629 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 23:03:39,629 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 23:03:39,629 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 23:03:39,630 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,631 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,631 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,632 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,632 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,632 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 23:03:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38937,1695423720190' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 23:03:39,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72c4ec89[Count = 1] remaining members to acquire global barrier 2023-09-22 23:03:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40697,1695423720223' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 23:03:39,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72c4ec89[Count = 0] remaining members to acquire global barrier 2023-09-22 23:03:39,635 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-22 23:03:39,635 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,641 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,641 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,641 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,642 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 23:03:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37507,1695423720143' in zk 2023-09-22 23:03:39,642 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,642 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:39,642 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 23:03:39,642 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. started... 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:39,642 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4d84015244b5c9bb32ab2de0b0eb0bfc 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 23:03:39,642 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 23:03:39,642 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. started... 2023-09-22 23:03:39,643 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0f63c4dc63828bc419284bcc22342ecc 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-22 23:03:39,643 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 23:03:39,643 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:39,643 DEBUG [member: 'jenkins-hbase4.apache.org,37507,1695423720143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 23:03:39,661 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922b68b9760ed2d495b87e77894f99bc844 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922b68b9760ed2d495b87e77894f99bc844 2023-09-22 23:03:39,662 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922a7a90438da51434bbeb5039957e01b95 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230922a7a90438da51434bbeb5039957e01b95 2023-09-22 23:03:39,668 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/.tmp/cf/544543176283435e824870f2c40ef55e 2023-09-22 23:03:39,668 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/.tmp/cf/08d76d98c0d5492994e5dcef17604cd7 2023-09-22 23:03:39,672 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/.tmp/cf/544543176283435e824870f2c40ef55e as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf/544543176283435e824870f2c40ef55e 2023-09-22 23:03:39,672 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/.tmp/cf/08d76d98c0d5492994e5dcef17604cd7 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf/08d76d98c0d5492994e5dcef17604cd7 2023-09-22 23:03:39,676 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf/08d76d98c0d5492994e5dcef17604cd7, entries=46, sequenceid=6, filesize=13.2 K 2023-09-22 23:03:39,676 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf/544543176283435e824870f2c40ef55e, entries=4, sequenceid=6, filesize=5.6 K 2023-09-22 23:03:39,677 INFO [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0f63c4dc63828bc419284bcc22342ecc in 35ms, sequenceid=6, compaction requested=false 2023-09-22 23:03:39,677 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-22 23:03:39,678 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f63c4dc63828bc419284bcc22342ecc: 2023-09-22 23:03:39,678 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,678 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:39,678 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf/08d76d98c0d5492994e5dcef17604cd7] hfiles 2023-09-22 23:03:39,678 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf/08d76d98c0d5492994e5dcef17604cd7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,681 INFO [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4d84015244b5c9bb32ab2de0b0eb0bfc in 39ms, sequenceid=6, compaction requested=false 2023-09-22 23:03:39,682 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d84015244b5c9bb32ab2de0b0eb0bfc: 2023-09-22 23:03:39,682 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,682 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 23:03:39,682 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf/544543176283435e824870f2c40ef55e] hfiles 2023-09-22 23:03:39,682 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf/544543176283435e824870f2c40ef55e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,687 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. completed. 2023-09-22 23:03:39,687 DEBUG [rs(jenkins-hbase4.apache.org,40697,1695423720223)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:39,687 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:39,687 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:39,687 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,687 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 23:03:39,687 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40697,1695423720223' in zk 2023-09-22 23:03:39,688 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. completed. 2023-09-22 23:03:39,688 DEBUG [rs(jenkins-hbase4.apache.org,38937,1695423720190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 23:03:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 23:03:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 23:03:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38937,1695423720190' in zk 2023-09-22 23:03:39,689 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 23:03:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,40697,1695423720223' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 23:03:39,691 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,691 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 23:03:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,691 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:39,691 DEBUG [member: 'jenkins-hbase4.apache.org,38937,1695423720190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 23:03:39,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40697,1695423720223': 2023-09-22 23:03:39,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40697,1695423720223' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-22 23:03:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38937,1695423720190': 2023-09-22 23:03:39,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38937,1695423720190' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-22 23:03:39,698 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-22 23:03:39,698 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 23:03:39,698 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 23:03:39,698 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,698 INFO [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 23:03:39,700 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,700 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,700 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 23:03:39,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 23:03:39,700 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,700 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,700 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 23:03:39,701 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,701 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,701 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:39,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 23:03:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-22 23:03:39,702 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 23:03:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,703 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 23:03:39,703 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 23:03:39,704 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,704 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,705 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 23:03:39,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 23:03:39,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,708 DEBUG [(jenkins-hbase4.apache.org,46029,1695423718942)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 23:03:39,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:03:39,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 23:03:39,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,710 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 23:03:39,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 23:03:39,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,710 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:39,710 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:39,710 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,710 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 23:03:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 23:03:39,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230922a7a90438da51434bbeb5039957e01b95, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922b68b9760ed2d495b87e77894f99bc844] mob files 2023-09-22 23:03:39,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230922a7a90438da51434bbeb5039957e01b95 2023-09-22 23:03:39,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922b68b9760ed2d495b87e77894f99bc844 2023-09-22 23:03:39,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-22 23:03:39,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,732 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695423819600Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695423819716 (+116 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695423819716Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695423819717 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695423819719 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695423819725 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695423819732 (+7 ms) 2023-09-22 23:03:39,735 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 23:03:39,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 134 msec 2023-09-22 23:03:39,903 DEBUG [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 23:03:39,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 23:03:39,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 23:03:39,904 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904 2023-09-22 23:03:39,904 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34671, tgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904, rawTgtDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904, srcFsUri=hdfs://localhost:34671, srcDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:03:39,926 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0 2023-09-22 23:03:39,926 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_36470516_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,926 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34671, inputRoot=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0, snapshotDir=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-22 23:03:39,940 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:39,953 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:39,953 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:39,954 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:39,954 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,823 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-2481150279182169466.jar 2023-09-22 23:03:40,824 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,824 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,890 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/hadoop-5054648892372779212.jar 2023-09-22 23:03:40,891 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,891 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,891 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,892 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,892 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,892 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 23:03:40,893 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 23:03:40,893 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 23:03:40,893 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 23:03:40,894 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 23:03:40,894 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 23:03:40,895 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 23:03:40,895 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 23:03:40,895 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 23:03:40,895 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 23:03:40,896 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 23:03:40,896 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:40,897 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:40,897 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 23:03:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:40,899 DEBUG [Listener at jenkins-hbase4.apache.org/32797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 23:03:41,260 WARN [Listener at jenkins-hbase4.apache.org/32797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 23:03:41,262 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-22 23:03:41,264 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-22 23:03:43,120 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:03:43,120 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 23:03:43,126 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0006_000001 (auth:SIMPLE) 2023-09-22 23:03:43,236 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0007_000001 (auth:SIMPLE) 2023-09-22 23:03:43,894 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 23:03:46,881 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0007_000001 (auth:SIMPLE) 2023-09-22 23:03:49,088 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0007_000001 (auth:SIMPLE) 2023-09-22 23:03:52,105 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0007_000001 (auth:SIMPLE) 2023-09-22 23:03:53,414 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 23:03:53,414 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 23:03:53,425 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,425 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 23:03:53,426 INFO [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 23:03:53,426 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,426 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-22 23:03:53,426 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-22 23:03:53,426 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_745818982_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,426 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-22 23:03:53,426 DEBUG [Listener at jenkins-hbase4.apache.org/32797] snapshot.TestExportSnapshot(367): hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/export-test/export-1695423819904/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-22 23:03:53,432 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 23:03:53,436 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423833436"}]},"ts":"1695423833436"} 2023-09-22 23:03:53,437 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-22 23:03:53,439 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-22 23:03:53,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d84015244b5c9bb32ab2de0b0eb0bfc, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f63c4dc63828bc419284bcc22342ecc, UNASSIGN}] 2023-09-22 23:03:53,441 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d84015244b5c9bb32ab2de0b0eb0bfc, UNASSIGN 2023-09-22 23:03:53,441 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f63c4dc63828bc419284bcc22342ecc, UNASSIGN 2023-09-22 23:03:53,442 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0f63c4dc63828bc419284bcc22342ecc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:03:53,442 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4d84015244b5c9bb32ab2de0b0eb0bfc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:03:53,442 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423833442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423833442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423833442"}]},"ts":"1695423833442"} 2023-09-22 23:03:53,442 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423833442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695423833442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695423833442"}]},"ts":"1695423833442"} 2023-09-22 23:03:53,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 4d84015244b5c9bb32ab2de0b0eb0bfc, server=jenkins-hbase4.apache.org,38937,1695423720190}] 2023-09-22 23:03:53,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 0f63c4dc63828bc419284bcc22342ecc, server=jenkins-hbase4.apache.org,40697,1695423720223}] 2023-09-22 23:03:53,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 23:03:53,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:53,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d84015244b5c9bb32ab2de0b0eb0bfc, disabling compactions & flushes 2023-09-22 23:03:53,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:53,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:53,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. after waiting 0 ms 2023-09-22 23:03:53,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:53,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:53,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f63c4dc63828bc419284bcc22342ecc, disabling compactions & flushes 2023-09-22 23:03:53,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:53,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:53,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. after waiting 0 ms 2023-09-22 23:03:53,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:53,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:03:53,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:03:53,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:53,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:03:53,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc. 2023-09-22 23:03:53,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc. 2023-09-22 23:03:53,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d84015244b5c9bb32ab2de0b0eb0bfc: 2023-09-22 23:03:53,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f63c4dc63828bc419284bcc22342ecc: 2023-09-22 23:03:53,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:53,612 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4d84015244b5c9bb32ab2de0b0eb0bfc, regionState=CLOSED 2023-09-22 23:03:53,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:53,612 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423833611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423833611"}]},"ts":"1695423833611"} 2023-09-22 23:03:53,612 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0f63c4dc63828bc419284bcc22342ecc, regionState=CLOSED 2023-09-22 23:03:53,612 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695423833612"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695423833612"}]},"ts":"1695423833612"} 2023-09-22 23:03:53,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-22 23:03:53,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 4d84015244b5c9bb32ab2de0b0eb0bfc, server=jenkins-hbase4.apache.org,38937,1695423720190 in 170 msec 2023-09-22 23:03:53,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-22 23:03:53,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 0f63c4dc63828bc419284bcc22342ecc, server=jenkins-hbase4.apache.org,40697,1695423720223 in 170 msec 2023-09-22 23:03:53,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d84015244b5c9bb32ab2de0b0eb0bfc, UNASSIGN in 176 msec 2023-09-22 23:03:53,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-22 23:03:53,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f63c4dc63828bc419284bcc22342ecc, UNASSIGN in 177 msec 2023-09-22 23:03:53,618 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695423833618"}]},"ts":"1695423833618"} 2023-09-22 23:03:53,619 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-22 23:03:53,621 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-22 23:03:53,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 190 msec 2023-09-22 23:03:53,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 23:03:53,738 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-22 23:03:53,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,741 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,742 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,744 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40697] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,746 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:53,746 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:53,746 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,746 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,746 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,747 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 23:03:53,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 23:03:53,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 23:03:53,748 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,748 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:53,748 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,748 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-22 23:03:53,748 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:53,748 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/recovered.edits] 2023-09-22 23:03:53,748 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 23:03:53,748 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:53,748 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf, FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/recovered.edits] 2023-09-22 23:03:53,748 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,748 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 23:03:53,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-22 23:03:53,752 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf/544543176283435e824870f2c40ef55e to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/cf/544543176283435e824870f2c40ef55e 2023-09-22 23:03:53,753 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf/08d76d98c0d5492994e5dcef17604cd7 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/cf/08d76d98c0d5492994e5dcef17604cd7 2023-09-22 23:03:53,756 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc/recovered.edits/9.seqid 2023-09-22 23:03:53,756 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/recovered.edits/9.seqid to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc/recovered.edits/9.seqid 2023-09-22 23:03:53,756 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d84015244b5c9bb32ab2de0b0eb0bfc 2023-09-22 23:03:53,756 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f63c4dc63828bc419284bcc22342ecc 2023-09-22 23:03:53,756 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-22 23:03:53,757 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-22 23:03:53,757 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-22 23:03:53,761 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230922a7a90438da51434bbeb5039957e01b95 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230922a7a90438da51434bbeb5039957e01b95 2023-09-22 23:03:53,762 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922b68b9760ed2d495b87e77894f99bc844 to hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922b68b9760ed2d495b87e77894f99bc844 2023-09-22 23:03:53,762 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-22 23:03:53,764 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,766 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-22 23:03:53,767 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-22 23:03:53,768 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,768 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-22 23:03:53,768 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423833768"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:53,768 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695423833768"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:53,770 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 23:03:53,770 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d84015244b5c9bb32ab2de0b0eb0bfc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695423818594.4d84015244b5c9bb32ab2de0b0eb0bfc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0f63c4dc63828bc419284bcc22342ecc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695423818594.0f63c4dc63828bc419284bcc22342ecc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 23:03:53,770 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-22 23:03:53,770 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695423833770"}]},"ts":"9223372036854775807"} 2023-09-22 23:03:53,771 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-22 23:03:53,774 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-09-22 23:03:53,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-22 23:03:53,851 INFO [Listener at jenkins-hbase4.apache.org/32797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-22 23:03:53,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-22 23:03:53,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-22 23:03:53,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46029] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 23:03:53,886 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 767), OpenFileDescriptor=917 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 194), ProcessCount=168 (was 168), AvailableMemoryMB=983 (was 1100) 2023-09-22 23:03:53,886 WARN [Listener at jenkins-hbase4.apache.org/32797] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-22 23:03:53,886 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-22 23:03:53,896 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-22 23:03:58,275 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695423726499_0007_000001 (auth:SIMPLE) 2023-09-22 23:03:59,175 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 23:04:08,021 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-22 23:04:22,138 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 23:04:22,138 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-22 23:04:22,250 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-22 23:04:22,256 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-22 23:04:22,257 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 23:04:22,264 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-22 23:04:22,367 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 23:04:22,367 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-22 23:04:22,367 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-22 23:04:22,367 INFO [Listener at jenkins-hbase4.apache.org/32797] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-22 23:04:22,367 DEBUG [Listener at jenkins-hbase4.apache.org/32797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bf08614 to 127.0.0.1:57942 2023-09-22 23:04:22,367 DEBUG [Listener at jenkins-hbase4.apache.org/32797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,368 DEBUG [Listener at jenkins-hbase4.apache.org/32797] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-22 23:04:22,368 DEBUG [Listener at jenkins-hbase4.apache.org/32797] util.JVMClusterUtil(257): Found active master hash=716539461, stopped=false 2023-09-22 23:04:22,368 DEBUG [Listener at jenkins-hbase4.apache.org/32797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:04:22,368 DEBUG [Listener at jenkins-hbase4.apache.org/32797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-22 23:04:22,368 INFO [Listener at jenkins-hbase4.apache.org/32797] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:04:22,369 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 23:04:22,369 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 23:04:22,369 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:04:22,369 INFO [Listener at jenkins-hbase4.apache.org/32797] procedure2.ProcedureExecutor(628): Stopping 2023-09-22 23:04:22,369 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 23:04:22,369 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 23:04:22,370 DEBUG [Listener at jenkins-hbase4.apache.org/32797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1544823e to 127.0.0.1:57942 2023-09-22 23:04:22,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 23:04:22,370 DEBUG [Listener at jenkins-hbase4.apache.org/32797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 23:04:22,370 INFO [Listener at jenkins-hbase4.apache.org/32797] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37507,1695423720143' ***** 2023-09-22 23:04:22,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 23:04:22,370 DEBUG [Listener at jenkins-hbase4.apache.org/32797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:04:22,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 23:04:22,371 INFO [Listener at jenkins-hbase4.apache.org/32797] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 23:04:22,371 INFO [Listener at jenkins-hbase4.apache.org/32797] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38937,1695423720190' ***** 2023-09-22 23:04:22,371 DEBUG [Listener at jenkins-hbase4.apache.org/32797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:04:22,371 INFO [Listener at jenkins-hbase4.apache.org/32797] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 23:04:22,371 INFO [RS:0;jenkins-hbase4:37507] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 23:04:22,371 INFO [Listener at jenkins-hbase4.apache.org/32797] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40697,1695423720223' ***** 2023-09-22 23:04:22,371 INFO [RS:1;jenkins-hbase4:38937] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 23:04:22,371 DEBUG [Listener at jenkins-hbase4.apache.org/32797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:04:22,371 INFO [RS:1;jenkins-hbase4:38937] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 23:04:22,371 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 23:04:22,371 INFO [RS:0;jenkins-hbase4:37507] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 23:04:22,371 INFO [RS:1;jenkins-hbase4:38937] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 23:04:22,371 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 23:04:22,371 INFO [Listener at jenkins-hbase4.apache.org/32797] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 23:04:22,371 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:04:22,371 INFO [RS:0;jenkins-hbase4:37507] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 23:04:22,372 DEBUG [RS:1;jenkins-hbase4:38937] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ac38707 to 127.0.0.1:57942 2023-09-22 23:04:22,372 INFO [RS:2;jenkins-hbase4:40697] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 23:04:22,372 DEBUG [RS:1;jenkins-hbase4:38937] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,372 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 23:04:22,372 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(3305): Received CLOSE for 756f00818605581423c8a972bdd5ce72 2023-09-22 23:04:22,372 INFO [RS:2;jenkins-hbase4:40697] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 23:04:22,372 INFO [RS:2;jenkins-hbase4:40697] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 23:04:22,372 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(3305): Received CLOSE for 5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:04:22,372 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:04:22,372 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:04:22,372 DEBUG [RS:0;jenkins-hbase4:37507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0556c14c to 127.0.0.1:57942 2023-09-22 23:04:22,374 INFO [RS:1;jenkins-hbase4:38937] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 23:04:22,374 DEBUG [RS:2;jenkins-hbase4:40697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x415e0276 to 127.0.0.1:57942 2023-09-22 23:04:22,375 INFO [RS:1;jenkins-hbase4:38937] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 23:04:22,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5a4bb34f0a816115bc31f674d1d009b9, disabling compactions & flushes 2023-09-22 23:04:22,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 756f00818605581423c8a972bdd5ce72, disabling compactions & flushes 2023-09-22 23:04:22,374 DEBUG [RS:0;jenkins-hbase4:37507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:04:22,376 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-22 23:04:22,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:04:22,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:04:22,375 INFO [RS:1;jenkins-hbase4:38937] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 23:04:22,375 DEBUG [RS:2;jenkins-hbase4:40697] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. after waiting 0 ms 2023-09-22 23:04:22,376 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1478): Online Regions={756f00818605581423c8a972bdd5ce72=hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72.} 2023-09-22 23:04:22,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:04:22,377 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-22 23:04:22,377 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-22 23:04:22,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:04:22,377 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1478): Online Regions={5a4bb34f0a816115bc31f674d1d009b9=hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9.} 2023-09-22 23:04:22,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. after waiting 0 ms 2023-09-22 23:04:22,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:04:22,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5a4bb34f0a816115bc31f674d1d009b9 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-22 23:04:22,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 756f00818605581423c8a972bdd5ce72 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-22 23:04:22,377 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-22 23:04:22,377 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-22 23:04:22,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-22 23:04:22,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-22 23:04:22,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-22 23:04:22,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-22 23:04:22,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-22 23:04:22,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-22 23:04:22,378 DEBUG [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1504): Waiting on 756f00818605581423c8a972bdd5ce72 2023-09-22 23:04:22,378 DEBUG [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-22 23:04:22,378 DEBUG [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1504): Waiting on 5a4bb34f0a816115bc31f674d1d009b9 2023-09-22 23:04:22,384 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 23:04:22,384 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 23:04:22,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72/.tmp/info/b888677f64be4a598306bf12a7468bca 2023-09-22 23:04:22,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/.tmp/info/b72792f15a224a1cae963120e071e91f 2023-09-22 23:04:22,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9/.tmp/l/d8edaaa09450423a92952faa6eff1774 2023-09-22 23:04:22,408 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b72792f15a224a1cae963120e071e91f 2023-09-22 23:04:22,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72/.tmp/info/b888677f64be4a598306bf12a7468bca as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72/info/b888677f64be4a598306bf12a7468bca 2023-09-22 23:04:22,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8edaaa09450423a92952faa6eff1774 2023-09-22 23:04:22,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9/.tmp/l/d8edaaa09450423a92952faa6eff1774 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9/l/d8edaaa09450423a92952faa6eff1774 2023-09-22 23:04:22,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72/info/b888677f64be4a598306bf12a7468bca, entries=2, sequenceid=6, filesize=4.8 K 2023-09-22 23:04:22,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 756f00818605581423c8a972bdd5ce72 in 41ms, sequenceid=6, compaction requested=false 2023-09-22 23:04:22,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8edaaa09450423a92952faa6eff1774 2023-09-22 23:04:22,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9/l/d8edaaa09450423a92952faa6eff1774, entries=7, sequenceid=18, filesize=5.2 K 2023-09-22 23:04:22,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 5a4bb34f0a816115bc31f674d1d009b9 in 42ms, sequenceid=18, compaction requested=false 2023-09-22 23:04:22,429 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 23:04:22,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/.tmp/rep_barrier/6a0d97f54e174644839f8191a7329887 2023-09-22 23:04:22,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/namespace/756f00818605581423c8a972bdd5ce72/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 23:04:22,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/acl/5a4bb34f0a816115bc31f674d1d009b9/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-22 23:04:22,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:04:22,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:04:22,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 756f00818605581423c8a972bdd5ce72: 2023-09-22 23:04:22,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:04:22,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695423722390.756f00818605581423c8a972bdd5ce72. 2023-09-22 23:04:22,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:04:22,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5a4bb34f0a816115bc31f674d1d009b9: 2023-09-22 23:04:22,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695423723136.5a4bb34f0a816115bc31f674d1d009b9. 2023-09-22 23:04:22,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a0d97f54e174644839f8191a7329887 2023-09-22 23:04:22,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/.tmp/table/17d4dcd5f9234378a78cfd78816ab937 2023-09-22 23:04:22,458 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17d4dcd5f9234378a78cfd78816ab937 2023-09-22 23:04:22,458 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/.tmp/info/b72792f15a224a1cae963120e071e91f as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/info/b72792f15a224a1cae963120e071e91f 2023-09-22 23:04:22,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b72792f15a224a1cae963120e071e91f 2023-09-22 23:04:22,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/info/b72792f15a224a1cae963120e071e91f, entries=48, sequenceid=131, filesize=10.3 K 2023-09-22 23:04:22,463 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/.tmp/rep_barrier/6a0d97f54e174644839f8191a7329887 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/rep_barrier/6a0d97f54e174644839f8191a7329887 2023-09-22 23:04:22,466 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a0d97f54e174644839f8191a7329887 2023-09-22 23:04:22,466 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/rep_barrier/6a0d97f54e174644839f8191a7329887, entries=13, sequenceid=131, filesize=6.4 K 2023-09-22 23:04:22,467 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/.tmp/table/17d4dcd5f9234378a78cfd78816ab937 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/table/17d4dcd5f9234378a78cfd78816ab937 2023-09-22 23:04:22,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17d4dcd5f9234378a78cfd78816ab937 2023-09-22 23:04:22,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/table/17d4dcd5f9234378a78cfd78816ab937, entries=24, sequenceid=131, filesize=6.9 K 2023-09-22 23:04:22,472 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 94ms, sequenceid=131, compaction requested=false 2023-09-22 23:04:22,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-22 23:04:22,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 23:04:22,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-22 23:04:22,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-22 23:04:22,482 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-22 23:04:22,482 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-22 23:04:22,578 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37507,1695423720143; all regions closed. 2023-09-22 23:04:22,578 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38937,1695423720190; all regions closed. 2023-09-22 23:04:22,578 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40697,1695423720223; all regions closed. 2023-09-22 23:04:22,593 DEBUG [RS:0;jenkins-hbase4:37507] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/oldWALs 2023-09-22 23:04:22,593 DEBUG [RS:1;jenkins-hbase4:38937] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/oldWALs 2023-09-22 23:04:22,593 INFO [RS:1;jenkins-hbase4:38937] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38937%2C1695423720190.meta:.meta(num 1695423722091) 2023-09-22 23:04:22,593 INFO [RS:0;jenkins-hbase4:37507] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37507%2C1695423720143:(num 1695423721929) 2023-09-22 23:04:22,593 DEBUG [RS:2;jenkins-hbase4:40697] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/oldWALs 2023-09-22 23:04:22,593 DEBUG [RS:0;jenkins-hbase4:37507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,593 INFO [RS:2;jenkins-hbase4:40697] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40697%2C1695423720223:(num 1695423721929) 2023-09-22 23:04:22,594 INFO [RS:0;jenkins-hbase4:37507] regionserver.LeaseManager(133): Closed leases 2023-09-22 23:04:22,594 DEBUG [RS:2;jenkins-hbase4:40697] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,594 INFO [RS:2;jenkins-hbase4:40697] regionserver.LeaseManager(133): Closed leases 2023-09-22 23:04:22,594 INFO [RS:0;jenkins-hbase4:37507] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-22 23:04:22,594 INFO [RS:2;jenkins-hbase4:40697] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-22 23:04:22,594 INFO [RS:0;jenkins-hbase4:37507] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 23:04:22,594 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 23:04:22,594 INFO [RS:0;jenkins-hbase4:37507] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 23:04:22,594 INFO [RS:0;jenkins-hbase4:37507] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 23:04:22,595 INFO [RS:2;jenkins-hbase4:40697] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 23:04:22,595 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 23:04:22,595 INFO [RS:2;jenkins-hbase4:40697] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 23:04:22,596 INFO [RS:2;jenkins-hbase4:40697] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 23:04:22,596 INFO [RS:0;jenkins-hbase4:37507] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37507 2023-09-22 23:04:22,597 INFO [RS:2;jenkins-hbase4:40697] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40697 2023-09-22 23:04:22,600 DEBUG [RS:1;jenkins-hbase4:38937] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/oldWALs 2023-09-22 23:04:22,600 INFO [RS:1;jenkins-hbase4:38937] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38937%2C1695423720190:(num 1695423721929) 2023-09-22 23:04:22,600 DEBUG [RS:1;jenkins-hbase4:38937] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,600 INFO [RS:1;jenkins-hbase4:38937] regionserver.LeaseManager(133): Closed leases 2023-09-22 23:04:22,601 INFO [RS:1;jenkins-hbase4:38937] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-22 23:04:22,601 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 23:04:22,602 INFO [RS:1;jenkins-hbase4:38937] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38937 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37507,1695423720143 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 23:04:22,605 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40697,1695423720223 2023-09-22 23:04:22,606 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:04:22,606 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:04:22,606 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38937,1695423720190 2023-09-22 23:04:22,608 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38937,1695423720190] 2023-09-22 23:04:22,609 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38937,1695423720190; numProcessing=1 2023-09-22 23:04:22,610 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38937,1695423720190 already deleted, retry=false 2023-09-22 23:04:22,610 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38937,1695423720190 expired; onlineServers=2 2023-09-22 23:04:22,610 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40697,1695423720223] 2023-09-22 23:04:22,610 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40697,1695423720223; numProcessing=2 2023-09-22 23:04:22,611 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40697,1695423720223 already deleted, retry=false 2023-09-22 23:04:22,611 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40697,1695423720223 expired; onlineServers=1 2023-09-22 23:04:22,611 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37507,1695423720143] 2023-09-22 23:04:22,611 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37507,1695423720143; numProcessing=3 2023-09-22 23:04:22,613 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37507,1695423720143 already deleted, retry=false 2023-09-22 23:04:22,613 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37507,1695423720143 expired; onlineServers=0 2023-09-22 23:04:22,613 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46029,1695423718942' ***** 2023-09-22 23:04:22,613 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-22 23:04:22,613 DEBUG [M:0;jenkins-hbase4:46029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b888c7e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-22 23:04:22,614 INFO [M:0;jenkins-hbase4:46029] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46029,1695423718942 2023-09-22 23:04:22,614 INFO [M:0;jenkins-hbase4:46029] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46029,1695423718942; all regions closed. 2023-09-22 23:04:22,614 DEBUG [M:0;jenkins-hbase4:46029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 23:04:22,614 DEBUG [M:0;jenkins-hbase4:46029] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-22 23:04:22,614 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-22 23:04:22,614 DEBUG [M:0;jenkins-hbase4:46029] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-22 23:04:22,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695423721560] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695423721560,5,FailOnTimeoutGroup] 2023-09-22 23:04:22,614 INFO [M:0;jenkins-hbase4:46029] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-22 23:04:22,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695423721560] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695423721560,5,FailOnTimeoutGroup] 2023-09-22 23:04:22,614 INFO [M:0;jenkins-hbase4:46029] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-22 23:04:22,614 INFO [M:0;jenkins-hbase4:46029] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-22 23:04:22,614 DEBUG [M:0;jenkins-hbase4:46029] master.HMaster(1512): Stopping service threads 2023-09-22 23:04:22,614 INFO [M:0;jenkins-hbase4:46029] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-22 23:04:22,614 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-22 23:04:22,615 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 23:04:22,615 ERROR [M:0;jenkins-hbase4:46029] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-22 23:04:22,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 23:04:22,615 INFO [M:0;jenkins-hbase4:46029] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-22 23:04:22,615 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-22 23:04:22,615 DEBUG [M:0;jenkins-hbase4:46029] zookeeper.ZKUtil(398): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-22 23:04:22,616 WARN [M:0;jenkins-hbase4:46029] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-22 23:04:22,616 INFO [M:0;jenkins-hbase4:46029] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-22 23:04:22,616 INFO [M:0;jenkins-hbase4:46029] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-22 23:04:22,616 DEBUG [M:0;jenkins-hbase4:46029] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-22 23:04:22,616 INFO [M:0;jenkins-hbase4:46029] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 23:04:22,616 DEBUG [M:0;jenkins-hbase4:46029] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 23:04:22,616 DEBUG [M:0;jenkins-hbase4:46029] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-22 23:04:22,616 DEBUG [M:0;jenkins-hbase4:46029] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 23:04:22,616 INFO [M:0;jenkins-hbase4:46029] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.93 KB heapSize=452.13 KB 2023-09-22 23:04:22,629 INFO [M:0;jenkins-hbase4:46029] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.93 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/705316e60b3449ee8abb54716bc54e84 2023-09-22 23:04:22,632 INFO [M:0;jenkins-hbase4:46029] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 705316e60b3449ee8abb54716bc54e84 2023-09-22 23:04:22,633 DEBUG [M:0;jenkins-hbase4:46029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/705316e60b3449ee8abb54716bc54e84 as hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/705316e60b3449ee8abb54716bc54e84 2023-09-22 23:04:22,637 INFO [M:0;jenkins-hbase4:46029] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 705316e60b3449ee8abb54716bc54e84 2023-09-22 23:04:22,637 INFO [M:0;jenkins-hbase4:46029] regionserver.HStore(1080): Added hdfs://localhost:34671/user/jenkins/test-data/f8d47e9b-bcdb-c7f7-98d4-062c8b55a7f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/705316e60b3449ee8abb54716bc54e84, entries=119, sequenceid=899, filesize=28.7 K 2023-09-22 23:04:22,638 INFO [M:0;jenkins-hbase4:46029] regionserver.HRegion(2948): Finished flush of dataSize ~375.93 KB/384949, heapSize ~452.11 KB/462960, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-09-22 23:04:22,639 INFO [M:0;jenkins-hbase4:46029] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 23:04:22,639 DEBUG [M:0;jenkins-hbase4:46029] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 23:04:22,642 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 23:04:22,642 INFO [M:0;jenkins-hbase4:46029] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-22 23:04:22,643 INFO [M:0;jenkins-hbase4:46029] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46029 2023-09-22 23:04:22,644 DEBUG [M:0;jenkins-hbase4:46029] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46029,1695423718942 already deleted, retry=false 2023-09-22 23:04:22,708 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 23:04:22,708 INFO [RS:0;jenkins-hbase4:37507] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37507,1695423720143; zookeeper connection closed. 2023-09-22 23:04:22,709 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:37507-0x100d5e01a070001, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 23:04:22,709 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5d12097f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5d12097f 2023-09-22 23:04:22,809 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 23:04:22,809 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): master:46029-0x100d5e01a070000, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 23:04:22,809 INFO [M:0;jenkins-hbase4:46029] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46029,1695423718942; zookeeper connection closed. 2023-09-22 23:04:22,909 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 23:04:22,909 INFO [RS:1;jenkins-hbase4:38937] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38937,1695423720190; zookeeper connection closed. 2023-09-22 23:04:22,909 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:38937-0x100d5e01a070002, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 23:04:22,909 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@a1c3a2c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@a1c3a2c 2023-09-22 23:04:23,009 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 23:04:23,009 INFO [RS:2;jenkins-hbase4:40697] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40697,1695423720223; zookeeper connection closed. 2023-09-22 23:04:23,009 DEBUG [Listener at localhost/35385-EventThread] zookeeper.ZKWatcher(600): regionserver:40697-0x100d5e01a070003, quorum=127.0.0.1:57942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 23:04:23,009 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@17a33b66] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@17a33b66 2023-09-22 23:04:23,010 INFO [Listener at jenkins-hbase4.apache.org/32797] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-22 23:04:23,010 WARN [Listener at jenkins-hbase4.apache.org/32797] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 23:04:23,013 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 23:04:23,116 WARN [BP-121153998-172.31.14.131-1695423715293 heartbeating to localhost/127.0.0.1:34671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 23:04:23,116 WARN [BP-121153998-172.31.14.131-1695423715293 heartbeating to localhost/127.0.0.1:34671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-121153998-172.31.14.131-1695423715293 (Datanode Uuid e61268c9-b787-4a84-953e-b189f68c8695) service to localhost/127.0.0.1:34671 2023-09-22 23:04:23,118 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data5/current/BP-121153998-172.31.14.131-1695423715293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 23:04:23,118 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data6/current/BP-121153998-172.31.14.131-1695423715293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 23:04:23,119 WARN [Listener at jenkins-hbase4.apache.org/32797] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 23:04:23,121 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 23:04:23,225 WARN [BP-121153998-172.31.14.131-1695423715293 heartbeating to localhost/127.0.0.1:34671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 23:04:23,225 WARN [BP-121153998-172.31.14.131-1695423715293 heartbeating to localhost/127.0.0.1:34671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-121153998-172.31.14.131-1695423715293 (Datanode Uuid ddc604b7-4ac5-418b-914c-b46819531879) service to localhost/127.0.0.1:34671 2023-09-22 23:04:23,226 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data3/current/BP-121153998-172.31.14.131-1695423715293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 23:04:23,226 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data4/current/BP-121153998-172.31.14.131-1695423715293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 23:04:23,227 WARN [Listener at jenkins-hbase4.apache.org/32797] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 23:04:23,229 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 23:04:23,332 WARN [BP-121153998-172.31.14.131-1695423715293 heartbeating to localhost/127.0.0.1:34671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 23:04:23,332 WARN [BP-121153998-172.31.14.131-1695423715293 heartbeating to localhost/127.0.0.1:34671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-121153998-172.31.14.131-1695423715293 (Datanode Uuid a8069c17-9a38-417e-8948-6db93b1f8ea2) service to localhost/127.0.0.1:34671 2023-09-22 23:04:23,333 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data1/current/BP-121153998-172.31.14.131-1695423715293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 23:04:23,333 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c632fd5-f4ec-8796-b2eb-f965357e559e/cluster_9e66ecf7-f910-4de5-b87a-fa2495eb6a0d/dfs/data/data2/current/BP-121153998-172.31.14.131-1695423715293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 23:04:23,355 INFO [Listener at jenkins-hbase4.apache.org/32797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 23:04:23,480 INFO [Listener at jenkins-hbase4.apache.org/32797] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-22 23:04:23,563 INFO [Listener at jenkins-hbase4.apache.org/32797] hbase.HBaseTestingUtility(1293): Minicluster is down