2023-10-04 06:59:21,450 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-04 06:59:21,654 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb 2023-10-04 06:59:21,654 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-04 06:59:21,654 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-04 06:59:21,695 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-04 06:59:21,901 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-04 06:59:21,901 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297, deleteOnExit=true 2023-10-04 06:59:21,902 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-04 06:59:21,902 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/test.cache.data in system properties and HBase conf 2023-10-04 06:59:21,903 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop.tmp.dir in system properties and HBase conf 2023-10-04 06:59:21,903 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop.log.dir in system properties and HBase conf 2023-10-04 06:59:21,904 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-04 06:59:21,904 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-04 06:59:21,904 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-04 06:59:22,201 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-04 06:59:22,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-04 06:59:22,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-04 06:59:22,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-04 06:59:22,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 06:59:22,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-04 06:59:22,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-04 06:59:22,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 06:59:22,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 06:59:22,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-04 06:59:22,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/nfs.dump.dir in system properties and HBase conf 2023-10-04 06:59:22,210 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir in system properties and HBase conf 2023-10-04 06:59:22,210 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 06:59:22,210 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-04 06:59:22,211 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-04 06:59:22,672 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-04 06:59:22,676 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-04 06:59:22,947 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-04 06:59:23,149 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-04 06:59:23,166 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 06:59:23,204 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 06:59:23,243 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir/Jetty_localhost_42607_hdfs____gfaip5/webapp 2023-10-04 06:59:23,367 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42607 2023-10-04 06:59:23,402 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-04 06:59:23,403 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-04 06:59:23,832 WARN [Listener at localhost/34823] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 06:59:23,917 WARN [Listener at localhost/34823] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 06:59:23,944 WARN [Listener at localhost/34823] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 06:59:23,953 INFO [Listener at localhost/34823] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 06:59:23,962 INFO [Listener at localhost/34823] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir/Jetty_localhost_45579_datanode____.6m48kj/webapp 2023-10-04 06:59:24,074 INFO [Listener at localhost/34823] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45579 2023-10-04 06:59:24,479 WARN [Listener at localhost/43129] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 06:59:24,491 WARN [Listener at localhost/43129] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 06:59:24,494 WARN [Listener at localhost/43129] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 06:59:24,496 INFO [Listener at localhost/43129] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 06:59:24,507 INFO [Listener at localhost/43129] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir/Jetty_localhost_40229_datanode____2lzjac/webapp 2023-10-04 06:59:24,613 INFO [Listener at localhost/43129] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40229 2023-10-04 06:59:24,626 WARN [Listener at localhost/43817] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 06:59:24,640 WARN [Listener at localhost/43817] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 06:59:24,646 WARN [Listener at localhost/43817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 06:59:24,648 INFO [Listener at localhost/43817] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 06:59:24,654 INFO [Listener at localhost/43817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir/Jetty_localhost_40401_datanode____.y1nj34/webapp 2023-10-04 06:59:24,759 INFO [Listener at localhost/43817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40401 2023-10-04 06:59:24,773 WARN [Listener at localhost/37329] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 06:59:25,010 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3609cd7fced220e2: Processing first storage report for DS-90a1029a-200d-4a6b-8201-a6bc47d19263 from datanode 65e438af-b549-4691-ad27-1f0227586024 2023-10-04 06:59:25,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3609cd7fced220e2: from storage DS-90a1029a-200d-4a6b-8201-a6bc47d19263 node DatanodeRegistration(127.0.0.1:33161, datanodeUuid=65e438af-b549-4691-ad27-1f0227586024, infoPort=35801, infoSecurePort=0, ipcPort=43817, storageInfo=lv=-57;cid=testClusterID;nsid=1593354029;c=1696402762747), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-04 06:59:25,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x27aed16fe35541e5: Processing first storage report for DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283 from datanode 7263680a-f9bc-44ae-ac69-8b43e6938033 2023-10-04 06:59:25,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x27aed16fe35541e5: from storage DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283 node DatanodeRegistration(127.0.0.1:39279, datanodeUuid=7263680a-f9bc-44ae-ac69-8b43e6938033, infoPort=37193, infoSecurePort=0, ipcPort=37329, storageInfo=lv=-57;cid=testClusterID;nsid=1593354029;c=1696402762747), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 06:59:25,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf25882c166e06acc: Processing first storage report for DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa from datanode 7948f1cb-ed9e-481a-acd9-bb0133918069 2023-10-04 06:59:25,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf25882c166e06acc: from storage DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa node DatanodeRegistration(127.0.0.1:43085, datanodeUuid=7948f1cb-ed9e-481a-acd9-bb0133918069, infoPort=45517, infoSecurePort=0, ipcPort=43129, storageInfo=lv=-57;cid=testClusterID;nsid=1593354029;c=1696402762747), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-04 06:59:25,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3609cd7fced220e2: Processing first storage report for DS-2949ae2e-1c5b-455a-aac4-6a9f705d0a93 from datanode 65e438af-b549-4691-ad27-1f0227586024 2023-10-04 06:59:25,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3609cd7fced220e2: from storage DS-2949ae2e-1c5b-455a-aac4-6a9f705d0a93 node DatanodeRegistration(127.0.0.1:33161, datanodeUuid=65e438af-b549-4691-ad27-1f0227586024, infoPort=35801, infoSecurePort=0, ipcPort=43817, storageInfo=lv=-57;cid=testClusterID;nsid=1593354029;c=1696402762747), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 06:59:25,013 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x27aed16fe35541e5: Processing first storage report for DS-d6a0db36-b214-4a51-9212-f8926197ed6c from datanode 7263680a-f9bc-44ae-ac69-8b43e6938033 2023-10-04 06:59:25,013 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x27aed16fe35541e5: from storage DS-d6a0db36-b214-4a51-9212-f8926197ed6c node DatanodeRegistration(127.0.0.1:39279, datanodeUuid=7263680a-f9bc-44ae-ac69-8b43e6938033, infoPort=37193, infoSecurePort=0, ipcPort=37329, storageInfo=lv=-57;cid=testClusterID;nsid=1593354029;c=1696402762747), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 06:59:25,013 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf25882c166e06acc: Processing first storage report for DS-5a646662-0fc9-490d-8ded-a6bddba3934d from datanode 7948f1cb-ed9e-481a-acd9-bb0133918069 2023-10-04 06:59:25,013 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf25882c166e06acc: from storage DS-5a646662-0fc9-490d-8ded-a6bddba3934d node DatanodeRegistration(127.0.0.1:43085, datanodeUuid=7948f1cb-ed9e-481a-acd9-bb0133918069, infoPort=45517, infoSecurePort=0, ipcPort=43129, storageInfo=lv=-57;cid=testClusterID;nsid=1593354029;c=1696402762747), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 06:59:25,187 DEBUG [Listener at localhost/37329] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb 2023-10-04 06:59:25,273 INFO [Listener at localhost/37329] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/zookeeper_0, clientPort=49707, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-04 06:59:25,298 INFO [Listener at localhost/37329] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49707 2023-10-04 06:59:25,309 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:25,312 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:25,976 INFO [Listener at localhost/37329] util.FSUtils(471): Created version file at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 with version=8 2023-10-04 06:59:25,976 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/hbase-staging 2023-10-04 06:59:26,260 INFO [Listener at localhost/37329] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-04 06:59:26,675 INFO [Listener at localhost/37329] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-10-04 06:59:26,704 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:26,704 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:26,704 INFO [Listener at localhost/37329] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 06:59:26,704 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:26,705 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 06:59:26,836 INFO [Listener at localhost/37329] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 06:59:26,902 DEBUG [Listener at localhost/37329] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-04 06:59:26,986 INFO [Listener at localhost/37329] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44183 2023-10-04 06:59:26,997 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:26,999 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:27,020 INFO [Listener at localhost/37329] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44183 connecting to ZooKeeper ensemble=127.0.0.1:49707 2023-10-04 06:59:27,070 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:441830x0, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 06:59:27,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44183-0x100fbbec6e50000 connected 2023-10-04 06:59:27,102 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 06:59:27,103 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 06:59:27,114 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 06:59:27,121 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44183 2023-10-04 06:59:27,121 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44183 2023-10-04 06:59:27,121 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44183 2023-10-04 06:59:27,122 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44183 2023-10-04 06:59:27,123 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44183 2023-10-04 06:59:27,128 INFO [Listener at localhost/37329] master.HMaster(444): hbase.rootdir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840, hbase.cluster.distributed=false 2023-10-04 06:59:27,187 INFO [Listener at localhost/37329] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-04 06:59:27,187 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,188 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,188 INFO [Listener at localhost/37329] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 06:59:27,188 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,188 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 06:59:27,192 INFO [Listener at localhost/37329] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 06:59:27,195 INFO [Listener at localhost/37329] ipc.NettyRpcServer(120): Bind to /148.251.75.209:32841 2023-10-04 06:59:27,198 INFO [Listener at localhost/37329] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 06:59:27,204 INFO [Listener at localhost/37329] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 06:59:27,205 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:27,207 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:27,211 INFO [Listener at localhost/37329] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32841 connecting to ZooKeeper ensemble=127.0.0.1:49707 2023-10-04 06:59:27,217 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:328410x0, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 06:59:27,218 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:328410x0, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 06:59:27,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32841-0x100fbbec6e50001 connected 2023-10-04 06:59:27,219 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 06:59:27,220 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 06:59:27,221 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32841 2023-10-04 06:59:27,222 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32841 2023-10-04 06:59:27,223 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32841 2023-10-04 06:59:27,224 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32841 2023-10-04 06:59:27,224 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32841 2023-10-04 06:59:27,236 INFO [Listener at localhost/37329] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-04 06:59:27,236 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,236 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,237 INFO [Listener at localhost/37329] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 06:59:27,237 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,237 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 06:59:27,238 INFO [Listener at localhost/37329] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 06:59:27,240 INFO [Listener at localhost/37329] ipc.NettyRpcServer(120): Bind to /148.251.75.209:45271 2023-10-04 06:59:27,240 INFO [Listener at localhost/37329] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 06:59:27,243 INFO [Listener at localhost/37329] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 06:59:27,244 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:27,247 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:27,250 INFO [Listener at localhost/37329] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45271 connecting to ZooKeeper ensemble=127.0.0.1:49707 2023-10-04 06:59:27,257 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:452710x0, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 06:59:27,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45271-0x100fbbec6e50002 connected 2023-10-04 06:59:27,259 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 06:59:27,260 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 06:59:27,261 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 06:59:27,262 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45271 2023-10-04 06:59:27,263 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45271 2023-10-04 06:59:27,263 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45271 2023-10-04 06:59:27,266 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45271 2023-10-04 06:59:27,267 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45271 2023-10-04 06:59:27,279 INFO [Listener at localhost/37329] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-04 06:59:27,279 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,279 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,279 INFO [Listener at localhost/37329] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 06:59:27,279 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 06:59:27,279 INFO [Listener at localhost/37329] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 06:59:27,280 INFO [Listener at localhost/37329] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 06:59:27,281 INFO [Listener at localhost/37329] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44825 2023-10-04 06:59:27,282 INFO [Listener at localhost/37329] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 06:59:27,283 INFO [Listener at localhost/37329] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 06:59:27,284 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:27,285 INFO [Listener at localhost/37329] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:27,287 INFO [Listener at localhost/37329] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44825 connecting to ZooKeeper ensemble=127.0.0.1:49707 2023-10-04 06:59:27,293 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:448250x0, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 06:59:27,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44825-0x100fbbec6e50003 connected 2023-10-04 06:59:27,295 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 06:59:27,296 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 06:59:27,297 DEBUG [Listener at localhost/37329] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 06:59:27,299 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44825 2023-10-04 06:59:27,299 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44825 2023-10-04 06:59:27,300 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44825 2023-10-04 06:59:27,302 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44825 2023-10-04 06:59:27,302 DEBUG [Listener at localhost/37329] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44825 2023-10-04 06:59:27,307 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 06:59:27,318 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-04 06:59:27,319 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 06:59:27,339 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 06:59:27,339 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 06:59:27,339 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 06:59:27,339 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 06:59:27,340 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:27,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-04 06:59:27,343 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44183,1696402766121 from backup master directory 2023-10-04 06:59:27,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-04 06:59:27,348 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 06:59:27,348 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-04 06:59:27,349 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 06:59:27,349 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 06:59:27,352 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-04 06:59:27,354 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-04 06:59:27,447 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/hbase.id with ID: 6abed90b-7948-4922-963d-7ade3adfc9ca 2023-10-04 06:59:27,496 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 06:59:27,513 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:27,561 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6a3e55e5 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:27,606 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d19a480, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:27,633 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-04 06:59:27,635 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-04 06:59:27,650 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-04 06:59:27,650 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-04 06:59:27,652 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-04 06:59:27,656 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-04 06:59:27,658 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 06:59:27,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store-tmp 2023-10-04 06:59:27,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:27,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-04 06:59:27,728 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 06:59:27,728 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 06:59:27,728 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-04 06:59:27,728 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 06:59:27,728 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 06:59:27,728 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 06:59:27,730 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/WALs/jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 06:59:27,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44183%2C1696402766121, suffix=, logDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/WALs/jenkins-hbase20.apache.org,44183,1696402766121, archiveDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/oldWALs, maxLogs=10 2023-10-04 06:59:27,807 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK] 2023-10-04 06:59:27,807 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK] 2023-10-04 06:59:27,807 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK] 2023-10-04 06:59:27,815 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-04 06:59:27,879 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/WALs/jenkins-hbase20.apache.org,44183,1696402766121/jenkins-hbase20.apache.org%2C44183%2C1696402766121.1696402767762 2023-10-04 06:59:27,879 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK], DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK], DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK]] 2023-10-04 06:59:27,880 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-04 06:59:27,880 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:27,883 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 06:59:27,884 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 06:59:27,948 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-04 06:59:27,955 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-04 06:59:27,980 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-04 06:59:27,992 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:27,998 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-04 06:59:28,000 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-04 06:59:28,015 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 06:59:28,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 06:59:28,020 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62973897, jitterRate=-0.06161580979824066}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 06:59:28,020 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 06:59:28,022 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-04 06:59:28,044 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-04 06:59:28,044 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-04 06:59:28,046 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-04 06:59:28,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-04 06:59:28,081 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 33 msec 2023-10-04 06:59:28,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-04 06:59:28,109 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-04 06:59:28,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-04 06:59:28,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-04 06:59:28,143 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-04 06:59:28,145 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-04 06:59:28,153 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-04 06:59:28,158 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-04 06:59:28,161 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:28,163 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-04 06:59:28,163 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-04 06:59:28,181 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-04 06:59:28,186 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 06:59:28,187 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 06:59:28,186 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 06:59:28,186 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 06:59:28,187 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:28,187 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,44183,1696402766121, sessionid=0x100fbbec6e50000, setting cluster-up flag (Was=false) 2023-10-04 06:59:28,205 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:28,209 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-04 06:59:28,211 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 06:59:28,216 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:28,219 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-04 06:59:28,221 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 06:59:28,223 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp 2023-10-04 06:59:28,297 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-04 06:59:28,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:28,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-04 06:59:28,306 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(951): ClusterId : 6abed90b-7948-4922-963d-7ade3adfc9ca 2023-10-04 06:59:28,306 INFO [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(951): ClusterId : 6abed90b-7948-4922-963d-7ade3adfc9ca 2023-10-04 06:59:28,307 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(951): ClusterId : 6abed90b-7948-4922-963d-7ade3adfc9ca 2023-10-04 06:59:28,313 DEBUG [RS:2;jenkins-hbase20:44825] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 06:59:28,313 DEBUG [RS:1;jenkins-hbase20:45271] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 06:59:28,313 DEBUG [RS:0;jenkins-hbase20:32841] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 06:59:28,319 DEBUG [RS:1;jenkins-hbase20:45271] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 06:59:28,319 DEBUG [RS:0;jenkins-hbase20:32841] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 06:59:28,319 DEBUG [RS:2;jenkins-hbase20:44825] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 06:59:28,319 DEBUG [RS:0;jenkins-hbase20:32841] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 06:59:28,319 DEBUG [RS:1;jenkins-hbase20:45271] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 06:59:28,319 DEBUG [RS:2;jenkins-hbase20:44825] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 06:59:28,323 DEBUG [RS:1;jenkins-hbase20:45271] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 06:59:28,323 DEBUG [RS:0;jenkins-hbase20:32841] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 06:59:28,324 DEBUG [RS:2;jenkins-hbase20:44825] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 06:59:28,326 DEBUG [RS:2;jenkins-hbase20:44825] zookeeper.ReadOnlyZKClient(139): Connect 0x5dd3451a to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:28,326 DEBUG [RS:1;jenkins-hbase20:45271] zookeeper.ReadOnlyZKClient(139): Connect 0x17e06f7b to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:28,326 DEBUG [RS:0;jenkins-hbase20:32841] zookeeper.ReadOnlyZKClient(139): Connect 0x624a9660 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:28,340 DEBUG [RS:1;jenkins-hbase20:45271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@192793f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:28,341 DEBUG [RS:1;jenkins-hbase20:45271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d18040b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-04 06:59:28,352 DEBUG [RS:2;jenkins-hbase20:44825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5314b0d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:28,352 DEBUG [RS:0;jenkins-hbase20:32841] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c8d6459, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:28,353 DEBUG [RS:2;jenkins-hbase20:44825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@572b2e6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-04 06:59:28,354 DEBUG [RS:0;jenkins-hbase20:32841] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2db06e62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-04 06:59:28,372 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:45271 2023-10-04 06:59:28,372 DEBUG [RS:2;jenkins-hbase20:44825] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:44825 2023-10-04 06:59:28,377 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:32841 2023-10-04 06:59:28,377 INFO [RS:2;jenkins-hbase20:44825] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 06:59:28,377 INFO [RS:0;jenkins-hbase20:32841] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 06:59:28,378 INFO [RS:2;jenkins-hbase20:44825] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 06:59:28,377 INFO [RS:1;jenkins-hbase20:45271] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 06:59:28,378 INFO [RS:0;jenkins-hbase20:32841] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 06:59:28,378 INFO [RS:1;jenkins-hbase20:45271] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 06:59:28,378 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 06:59:28,378 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 06:59:28,378 DEBUG [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 06:59:28,379 INFO [RS:0;jenkins-hbase20:32841] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:28,379 INFO [RS:1;jenkins-hbase20:45271] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:28,380 INFO [RS:2;jenkins-hbase20:44825] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:28,380 DEBUG [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 06:59:28,380 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 06:59:28,380 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 06:59:28,382 INFO [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44183,1696402766121 with isa=jenkins-hbase20.apache.org/148.251.75.209:44825, startcode=1696402767278 2023-10-04 06:59:28,382 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44183,1696402766121 with isa=jenkins-hbase20.apache.org/148.251.75.209:32841, startcode=1696402767186 2023-10-04 06:59:28,382 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44183,1696402766121 with isa=jenkins-hbase20.apache.org/148.251.75.209:45271, startcode=1696402767235 2023-10-04 06:59:28,393 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-04 06:59:28,400 DEBUG [RS:2;jenkins-hbase20:44825] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 06:59:28,400 DEBUG [RS:1;jenkins-hbase20:45271] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 06:59:28,400 DEBUG [RS:0;jenkins-hbase20:32841] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 06:59:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-04 06:59:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-04 06:59:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-04 06:59:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-04 06:59:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-10-04 06:59:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-04 06:59:28,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,410 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696402798410 2023-10-04 06:59:28,412 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-04 06:59:28,414 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-04 06:59:28,414 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-04 06:59:28,419 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 06:59:28,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-04 06:59:28,437 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-04 06:59:28,440 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-04 06:59:28,440 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-04 06:59:28,440 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-04 06:59:28,441 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,442 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-04 06:59:28,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-04 06:59:28,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-04 06:59:28,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-04 06:59:28,451 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-04 06:59:28,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696402768454,5,FailOnTimeoutGroup] 2023-10-04 06:59:28,455 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696402768454,5,FailOnTimeoutGroup] 2023-10-04 06:59:28,455 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,455 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-04 06:59:28,457 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,457 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,463 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57121, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 06:59:28,463 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51823, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 06:59:28,463 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41993, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 06:59:28,485 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44183] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:28,485 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-04 06:59:28,487 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-04 06:59:28,487 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 06:59:28,503 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44183] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:28,506 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44183] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:28,514 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 06:59:28,514 DEBUG [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 06:59:28,514 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 06:59:28,515 DEBUG [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34823 2023-10-04 06:59:28,515 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34823 2023-10-04 06:59:28,515 DEBUG [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 06:59:28,515 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34823 2023-10-04 06:59:28,516 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 06:59:28,516 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 06:59:28,518 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:28,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-04 06:59:28,522 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 06:59:28,524 DEBUG [RS:0;jenkins-hbase20:32841] zookeeper.ZKUtil(162): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:28,524 DEBUG [RS:1;jenkins-hbase20:45271] zookeeper.ZKUtil(162): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:28,524 WARN [RS:0;jenkins-hbase20:32841] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 06:59:28,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/info 2023-10-04 06:59:28,524 WARN [RS:1;jenkins-hbase20:45271] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 06:59:28,525 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,45271,1696402767235] 2023-10-04 06:59:28,526 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44825,1696402767278] 2023-10-04 06:59:28,525 DEBUG [RS:2;jenkins-hbase20:44825] zookeeper.ZKUtil(162): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:28,525 INFO [RS:0;jenkins-hbase20:32841] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 06:59:28,526 WARN [RS:2;jenkins-hbase20:44825] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 06:59:28,526 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,32841,1696402767186] 2023-10-04 06:59:28,525 INFO [RS:1;jenkins-hbase20:45271] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 06:59:28,526 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-04 06:59:28,526 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:28,526 INFO [RS:2;jenkins-hbase20:44825] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 06:59:28,527 DEBUG [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:28,526 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:28,532 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:28,535 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-04 06:59:28,541 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/rep_barrier 2023-10-04 06:59:28,541 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-04 06:59:28,542 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:28,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-04 06:59:28,545 DEBUG [RS:2;jenkins-hbase20:44825] zookeeper.ZKUtil(162): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:28,545 DEBUG [RS:1;jenkins-hbase20:45271] zookeeper.ZKUtil(162): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:28,546 DEBUG [RS:0;jenkins-hbase20:32841] zookeeper.ZKUtil(162): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:28,546 DEBUG [RS:1;jenkins-hbase20:45271] zookeeper.ZKUtil(162): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:28,546 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/table 2023-10-04 06:59:28,546 DEBUG [RS:2;jenkins-hbase20:44825] zookeeper.ZKUtil(162): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:28,546 DEBUG [RS:0;jenkins-hbase20:32841] zookeeper.ZKUtil(162): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:28,546 DEBUG [RS:1;jenkins-hbase20:45271] zookeeper.ZKUtil(162): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:28,546 DEBUG [RS:2;jenkins-hbase20:44825] zookeeper.ZKUtil(162): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:28,547 DEBUG [RS:0;jenkins-hbase20:32841] zookeeper.ZKUtil(162): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:28,547 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-04 06:59:28,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:28,550 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740 2023-10-04 06:59:28,551 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740 2023-10-04 06:59:28,555 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-04 06:59:28,557 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-04 06:59:28,563 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 06:59:28,564 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 06:59:28,563 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 06:59:28,563 DEBUG [RS:2;jenkins-hbase20:44825] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 06:59:28,565 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66957099, jitterRate=-0.0022614747285842896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-04 06:59:28,565 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-04 06:59:28,565 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-04 06:59:28,565 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-04 06:59:28,565 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-04 06:59:28,565 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-04 06:59:28,565 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-04 06:59:28,575 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-04 06:59:28,575 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-04 06:59:28,581 INFO [RS:1;jenkins-hbase20:45271] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 06:59:28,581 INFO [RS:2;jenkins-hbase20:44825] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 06:59:28,581 INFO [RS:0;jenkins-hbase20:32841] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 06:59:28,583 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-04 06:59:28,584 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-04 06:59:28,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-04 06:59:28,608 INFO [RS:1;jenkins-hbase20:45271] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 06:59:28,609 INFO [RS:0;jenkins-hbase20:32841] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 06:59:28,608 INFO [RS:2;jenkins-hbase20:44825] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 06:59:28,611 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-04 06:59:28,614 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-04 06:59:28,616 INFO [RS:2;jenkins-hbase20:44825] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 06:59:28,617 INFO [RS:1;jenkins-hbase20:45271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 06:59:28,616 INFO [RS:0;jenkins-hbase20:32841] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 06:59:28,617 INFO [RS:1;jenkins-hbase20:45271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,617 INFO [RS:2;jenkins-hbase20:44825] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,617 INFO [RS:0;jenkins-hbase20:32841] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,618 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 06:59:28,619 INFO [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 06:59:28,619 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 06:59:28,627 INFO [RS:2;jenkins-hbase20:44825] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,627 INFO [RS:0;jenkins-hbase20:32841] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,627 INFO [RS:1;jenkins-hbase20:45271] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,627 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,628 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,628 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,628 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,628 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,628 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,628 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,628 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-04 06:59:28,629 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-04 06:59:28,629 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,630 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,630 DEBUG [RS:2;jenkins-hbase20:44825] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,629 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,630 DEBUG [RS:1;jenkins-hbase20:45271] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,630 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,631 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-04 06:59:28,631 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,631 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,631 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,632 DEBUG [RS:0;jenkins-hbase20:32841] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 06:59:28,632 INFO [RS:1;jenkins-hbase20:45271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,632 INFO [RS:2;jenkins-hbase20:44825] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,632 INFO [RS:1;jenkins-hbase20:45271] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,633 INFO [RS:2;jenkins-hbase20:44825] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,633 INFO [RS:1;jenkins-hbase20:45271] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,633 INFO [RS:2;jenkins-hbase20:44825] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,637 INFO [RS:0;jenkins-hbase20:32841] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,637 INFO [RS:0;jenkins-hbase20:32841] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,638 INFO [RS:0;jenkins-hbase20:32841] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,650 INFO [RS:1;jenkins-hbase20:45271] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 06:59:28,651 INFO [RS:2;jenkins-hbase20:44825] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 06:59:28,652 INFO [RS:0;jenkins-hbase20:32841] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 06:59:28,653 INFO [RS:1;jenkins-hbase20:45271] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45271,1696402767235-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,653 INFO [RS:0;jenkins-hbase20:32841] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32841,1696402767186-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,653 INFO [RS:2;jenkins-hbase20:44825] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44825,1696402767278-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:28,669 INFO [RS:0;jenkins-hbase20:32841] regionserver.Replication(203): jenkins-hbase20.apache.org,32841,1696402767186 started 2023-10-04 06:59:28,669 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,32841,1696402767186, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:32841, sessionid=0x100fbbec6e50001 2023-10-04 06:59:28,670 DEBUG [RS:0;jenkins-hbase20:32841] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 06:59:28,670 DEBUG [RS:0;jenkins-hbase20:32841] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:28,670 DEBUG [RS:0;jenkins-hbase20:32841] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,32841,1696402767186' 2023-10-04 06:59:28,670 DEBUG [RS:0;jenkins-hbase20:32841] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 06:59:28,670 DEBUG [RS:0;jenkins-hbase20:32841] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 06:59:28,671 DEBUG [RS:0;jenkins-hbase20:32841] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 06:59:28,671 DEBUG [RS:0;jenkins-hbase20:32841] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 06:59:28,671 DEBUG [RS:0;jenkins-hbase20:32841] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:28,671 DEBUG [RS:0;jenkins-hbase20:32841] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,32841,1696402767186' 2023-10-04 06:59:28,671 DEBUG [RS:0;jenkins-hbase20:32841] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:28,672 DEBUG [RS:0;jenkins-hbase20:32841] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:28,672 DEBUG [RS:0;jenkins-hbase20:32841] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 06:59:28,672 INFO [RS:0;jenkins-hbase20:32841] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 06:59:28,672 INFO [RS:0;jenkins-hbase20:32841] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 06:59:28,674 INFO [RS:1;jenkins-hbase20:45271] regionserver.Replication(203): jenkins-hbase20.apache.org,45271,1696402767235 started 2023-10-04 06:59:28,674 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,45271,1696402767235, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:45271, sessionid=0x100fbbec6e50002 2023-10-04 06:59:28,674 DEBUG [RS:1;jenkins-hbase20:45271] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 06:59:28,674 DEBUG [RS:1;jenkins-hbase20:45271] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:28,675 DEBUG [RS:1;jenkins-hbase20:45271] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,45271,1696402767235' 2023-10-04 06:59:28,675 DEBUG [RS:1;jenkins-hbase20:45271] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 06:59:28,676 DEBUG [RS:1;jenkins-hbase20:45271] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 06:59:28,676 INFO [RS:2;jenkins-hbase20:44825] regionserver.Replication(203): jenkins-hbase20.apache.org,44825,1696402767278 started 2023-10-04 06:59:28,676 INFO [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44825,1696402767278, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44825, sessionid=0x100fbbec6e50003 2023-10-04 06:59:28,677 DEBUG [RS:1;jenkins-hbase20:45271] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 06:59:28,677 DEBUG [RS:1;jenkins-hbase20:45271] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 06:59:28,677 DEBUG [RS:2;jenkins-hbase20:44825] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 06:59:28,677 DEBUG [RS:1;jenkins-hbase20:45271] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:28,677 DEBUG [RS:2;jenkins-hbase20:44825] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:28,677 DEBUG [RS:1;jenkins-hbase20:45271] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,45271,1696402767235' 2023-10-04 06:59:28,678 DEBUG [RS:1;jenkins-hbase20:45271] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:28,678 DEBUG [RS:2;jenkins-hbase20:44825] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44825,1696402767278' 2023-10-04 06:59:28,678 DEBUG [RS:2;jenkins-hbase20:44825] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 06:59:28,678 DEBUG [RS:1;jenkins-hbase20:45271] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:28,678 DEBUG [RS:2;jenkins-hbase20:44825] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 06:59:28,679 DEBUG [RS:1;jenkins-hbase20:45271] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 06:59:28,679 DEBUG [RS:2;jenkins-hbase20:44825] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 06:59:28,679 INFO [RS:1;jenkins-hbase20:45271] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 06:59:28,679 DEBUG [RS:2;jenkins-hbase20:44825] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 06:59:28,679 INFO [RS:1;jenkins-hbase20:45271] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 06:59:28,680 DEBUG [RS:2;jenkins-hbase20:44825] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:28,680 DEBUG [RS:2;jenkins-hbase20:44825] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44825,1696402767278' 2023-10-04 06:59:28,680 DEBUG [RS:2;jenkins-hbase20:44825] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:28,681 DEBUG [RS:2;jenkins-hbase20:44825] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:28,681 DEBUG [RS:2;jenkins-hbase20:44825] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 06:59:28,681 INFO [RS:2;jenkins-hbase20:44825] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 06:59:28,681 INFO [RS:2;jenkins-hbase20:44825] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 06:59:28,766 DEBUG [jenkins-hbase20:44183] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-04 06:59:28,770 DEBUG [jenkins-hbase20:44183] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 06:59:28,776 DEBUG [jenkins-hbase20:44183] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 06:59:28,776 DEBUG [jenkins-hbase20:44183] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 06:59:28,776 DEBUG [jenkins-hbase20:44183] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 06:59:28,776 DEBUG [jenkins-hbase20:44183] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 06:59:28,779 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,32841,1696402767186, state=OPENING 2023-10-04 06:59:28,782 INFO [RS:0;jenkins-hbase20:32841] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C32841%2C1696402767186, suffix=, logDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,32841,1696402767186, archiveDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/oldWALs, maxLogs=32 2023-10-04 06:59:28,783 INFO [RS:1;jenkins-hbase20:45271] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45271%2C1696402767235, suffix=, logDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,45271,1696402767235, archiveDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/oldWALs, maxLogs=32 2023-10-04 06:59:28,784 INFO [RS:2;jenkins-hbase20:44825] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44825%2C1696402767278, suffix=, logDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,44825,1696402767278, archiveDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/oldWALs, maxLogs=32 2023-10-04 06:59:28,786 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-04 06:59:28,787 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:28,788 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-04 06:59:28,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 06:59:28,813 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK] 2023-10-04 06:59:28,813 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK] 2023-10-04 06:59:28,828 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK] 2023-10-04 06:59:28,832 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK] 2023-10-04 06:59:28,835 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK] 2023-10-04 06:59:28,836 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK] 2023-10-04 06:59:28,837 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK] 2023-10-04 06:59:28,837 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK] 2023-10-04 06:59:28,838 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK] 2023-10-04 06:59:28,859 INFO [RS:2;jenkins-hbase20:44825] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,44825,1696402767278/jenkins-hbase20.apache.org%2C44825%2C1696402767278.1696402768787 2023-10-04 06:59:28,860 INFO [RS:1;jenkins-hbase20:45271] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,45271,1696402767235/jenkins-hbase20.apache.org%2C45271%2C1696402767235.1696402768786 2023-10-04 06:59:28,860 DEBUG [RS:2;jenkins-hbase20:44825] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK], DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK], DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK]] 2023-10-04 06:59:28,860 INFO [RS:0;jenkins-hbase20:32841] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,32841,1696402767186/jenkins-hbase20.apache.org%2C32841%2C1696402767186.1696402768786 2023-10-04 06:59:28,861 DEBUG [RS:1;jenkins-hbase20:45271] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK], DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK], DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK]] 2023-10-04 06:59:28,862 DEBUG [RS:0;jenkins-hbase20:32841] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK], DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK], DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK]] 2023-10-04 06:59:29,030 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:29,032 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 06:59:29,035 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 06:59:29,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-04 06:59:29,050 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 06:59:29,054 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C32841%2C1696402767186.meta, suffix=.meta, logDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,32841,1696402767186, archiveDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/oldWALs, maxLogs=32 2023-10-04 06:59:29,072 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK] 2023-10-04 06:59:29,073 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK] 2023-10-04 06:59:29,075 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK] 2023-10-04 06:59:29,083 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/WALs/jenkins-hbase20.apache.org,32841,1696402767186/jenkins-hbase20.apache.org%2C32841%2C1696402767186.meta.1696402769055.meta 2023-10-04 06:59:29,084 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43085,DS-34ef50ce-8d8d-4c0d-84b6-803f2fff8dfa,DISK], DatanodeInfoWithStorage[127.0.0.1:33161,DS-90a1029a-200d-4a6b-8201-a6bc47d19263,DISK], DatanodeInfoWithStorage[127.0.0.1:39279,DS-26ae41fa-c493-41e4-8b0b-f8a359fa2283,DISK]] 2023-10-04 06:59:29,084 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-04 06:59:29,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-04 06:59:29,089 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:29,091 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-04 06:59:29,094 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-04 06:59:29,096 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-04 06:59:29,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-04 06:59:29,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:29,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-04 06:59:29,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-04 06:59:29,115 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-04 06:59:29,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/info 2023-10-04 06:59:29,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/info 2023-10-04 06:59:29,118 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-04 06:59:29,118 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:29,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-04 06:59:29,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/rep_barrier 2023-10-04 06:59:29,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/rep_barrier 2023-10-04 06:59:29,121 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-04 06:59:29,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:29,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-04 06:59:29,124 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/table 2023-10-04 06:59:29,124 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/table 2023-10-04 06:59:29,124 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-04 06:59:29,125 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:29,127 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740 2023-10-04 06:59:29,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740 2023-10-04 06:59:29,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-04 06:59:29,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-04 06:59:29,137 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61940393, jitterRate=-0.07701621949672699}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-04 06:59:29,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-04 06:59:29,151 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696402769024 2023-10-04 06:59:29,168 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-04 06:59:29,169 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-04 06:59:29,170 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,32841,1696402767186, state=OPEN 2023-10-04 06:59:29,173 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-04 06:59:29,173 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-04 06:59:29,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-04 06:59:29,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,32841,1696402767186 in 380 msec 2023-10-04 06:59:29,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-04 06:59:29,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 586 msec 2023-10-04 06:59:29,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 882 msec 2023-10-04 06:59:29,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696402769194, completionTime=-1 2023-10-04 06:59:29,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-04 06:59:29,195 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-04 06:59:29,254 DEBUG [hconnection-0x3cfd64be-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:29,258 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:29,277 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-04 06:59:29,277 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696402829277 2023-10-04 06:59:29,277 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696402889277 2023-10-04 06:59:29,278 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 82 msec 2023-10-04 06:59:29,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44183,1696402766121-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:29,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44183,1696402766121-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:29,309 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44183,1696402766121-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:29,311 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44183, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:29,311 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-04 06:59:29,319 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-04 06:59:29,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-04 06:59:29,330 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 06:59:29,368 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-04 06:59:29,371 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 06:59:29,375 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 06:59:29,397 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,401 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e empty. 2023-10-04 06:59:29,403 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,403 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-04 06:59:29,449 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-04 06:59:29,451 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c2422e03be5de6fa3dc4c9321dd79a8e, NAME => 'hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 06:59:29,473 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:29,473 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c2422e03be5de6fa3dc4c9321dd79a8e, disabling compactions & flushes 2023-10-04 06:59:29,473 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 06:59:29,473 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 06:59:29,473 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. after waiting 0 ms 2023-10-04 06:59:29,473 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 06:59:29,474 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 06:59:29,474 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c2422e03be5de6fa3dc4c9321dd79a8e: 2023-10-04 06:59:29,479 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 06:59:29,491 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696402769482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402769482"}]},"ts":"1696402769482"} 2023-10-04 06:59:29,519 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-04 06:59:29,523 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 06:59:29,527 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402769523"}]},"ts":"1696402769523"} 2023-10-04 06:59:29,531 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-04 06:59:29,535 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 06:59:29,537 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 06:59:29,537 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 06:59:29,537 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 06:59:29,537 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 06:59:29,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c2422e03be5de6fa3dc4c9321dd79a8e, ASSIGN}] 2023-10-04 06:59:29,543 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c2422e03be5de6fa3dc4c9321dd79a8e, ASSIGN 2023-10-04 06:59:29,545 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c2422e03be5de6fa3dc4c9321dd79a8e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45271,1696402767235; forceNewPlan=false, retain=false 2023-10-04 06:59:29,697 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 06:59:29,698 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c2422e03be5de6fa3dc4c9321dd79a8e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:29,699 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696402769698"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402769698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402769698"}]},"ts":"1696402769698"} 2023-10-04 06:59:29,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c2422e03be5de6fa3dc4c9321dd79a8e, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 06:59:29,859 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:29,859 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 06:59:29,863 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 06:59:29,870 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 06:59:29,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2422e03be5de6fa3dc4c9321dd79a8e, NAME => 'hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e.', STARTKEY => '', ENDKEY => ''} 2023-10-04 06:59:29,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. service=AccessControlService 2023-10-04 06:59:29,871 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:29,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:29,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,875 INFO [StoreOpener-c2422e03be5de6fa3dc4c9321dd79a8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,877 DEBUG [StoreOpener-c2422e03be5de6fa3dc4c9321dd79a8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e/info 2023-10-04 06:59:29,878 DEBUG [StoreOpener-c2422e03be5de6fa3dc4c9321dd79a8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e/info 2023-10-04 06:59:29,878 INFO [StoreOpener-c2422e03be5de6fa3dc4c9321dd79a8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2422e03be5de6fa3dc4c9321dd79a8e columnFamilyName info 2023-10-04 06:59:29,879 INFO [StoreOpener-c2422e03be5de6fa3dc4c9321dd79a8e-1] regionserver.HStore(310): Store=c2422e03be5de6fa3dc4c9321dd79a8e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:29,882 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,883 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,888 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 06:59:29,892 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 06:59:29,893 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c2422e03be5de6fa3dc4c9321dd79a8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69132087, jitterRate=0.030148372054100037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 06:59:29,893 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c2422e03be5de6fa3dc4c9321dd79a8e: 2023-10-04 06:59:29,895 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e., pid=6, masterSystemTime=1696402769859 2023-10-04 06:59:29,900 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 06:59:29,901 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 06:59:29,902 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c2422e03be5de6fa3dc4c9321dd79a8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:29,903 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696402769902"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402769902"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402769902"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402769902"}]},"ts":"1696402769902"} 2023-10-04 06:59:29,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-04 06:59:29,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c2422e03be5de6fa3dc4c9321dd79a8e, server=jenkins-hbase20.apache.org,45271,1696402767235 in 203 msec 2023-10-04 06:59:29,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-04 06:59:29,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c2422e03be5de6fa3dc4c9321dd79a8e, ASSIGN in 371 msec 2023-10-04 06:59:29,917 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 06:59:29,918 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402769917"}]},"ts":"1696402769917"} 2023-10-04 06:59:29,921 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-04 06:59:29,924 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 06:59:29,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 593 msec 2023-10-04 06:59:29,971 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-04 06:59:29,973 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-04 06:59:29,973 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:29,992 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:29,995 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:30,007 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-04 06:59:30,025 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-04 06:59:30,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-10-04 06:59:30,040 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-04 06:59:30,053 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-04 06:59:30,059 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-10-04 06:59:30,071 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-04 06:59:30,073 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-04 06:59:30,073 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.724sec 2023-10-04 06:59:30,076 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-04 06:59:30,078 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-04 06:59:30,078 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-04 06:59:30,079 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44183,1696402766121-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-04 06:59:30,080 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44183,1696402766121-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-04 06:59:30,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 06:59:30,102 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-04 06:59:30,105 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 06:59:30,106 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 06:59:30,109 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-04 06:59:30,112 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,113 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780 empty. 2023-10-04 06:59:30,116 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,116 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-04 06:59:30,117 DEBUG [Listener at localhost/37329] zookeeper.ReadOnlyZKClient(139): Connect 0x326622aa to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:30,119 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 06:59:30,130 DEBUG [Listener at localhost/37329] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f1e3164, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:30,151 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-04 06:59:30,153 DEBUG [hconnection-0x178bf7aa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:30,153 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 15427b4f939a97260e6bd2e474ae1780, NAME => 'hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 06:59:30,166 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:30,170 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 06:59:30,171 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-04 06:59:30,171 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/test.cache.data in system properties and HBase conf 2023-10-04 06:59:30,171 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop.tmp.dir in system properties and HBase conf 2023-10-04 06:59:30,172 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop.log.dir in system properties and HBase conf 2023-10-04 06:59:30,172 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-04 06:59:30,172 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-04 06:59:30,172 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-04 06:59:30,172 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-04 06:59:30,172 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-04 06:59:30,172 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/nfs.dump.dir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-04 06:59:30,173 INFO [Listener at localhost/37329] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-04 06:59:30,186 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:30,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 15427b4f939a97260e6bd2e474ae1780, disabling compactions & flushes 2023-10-04 06:59:30,187 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 06:59:30,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 06:59:30,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. after waiting 0 ms 2023-10-04 06:59:30,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 06:59:30,187 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 06:59:30,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 15427b4f939a97260e6bd2e474ae1780: 2023-10-04 06:59:30,192 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 06:59:30,193 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696402770193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402770193"}]},"ts":"1696402770193"} 2023-10-04 06:59:30,197 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-04 06:59:30,198 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 06:59:30,199 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402770199"}]},"ts":"1696402770199"} 2023-10-04 06:59:30,202 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-04 06:59:30,205 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 06:59:30,206 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 06:59:30,206 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 06:59:30,206 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 06:59:30,206 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 06:59:30,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=15427b4f939a97260e6bd2e474ae1780, ASSIGN}] 2023-10-04 06:59:30,210 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=15427b4f939a97260e6bd2e474ae1780, ASSIGN 2023-10-04 06:59:30,211 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=15427b4f939a97260e6bd2e474ae1780, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32841,1696402767186; forceNewPlan=false, retain=false 2023-10-04 06:59:30,225 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 06:59:30,362 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 06:59:30,363 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=15427b4f939a97260e6bd2e474ae1780, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:30,364 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696402770363"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402770363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402770363"}]},"ts":"1696402770363"} 2023-10-04 06:59:30,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 15427b4f939a97260e6bd2e474ae1780, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 06:59:30,426 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 06:59:30,528 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 06:59:30,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15427b4f939a97260e6bd2e474ae1780, NAME => 'hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780.', STARTKEY => '', ENDKEY => ''} 2023-10-04 06:59:30,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. service=AccessControlService 2023-10-04 06:59:30,529 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:30,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,530 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:30,530 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,530 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,532 INFO [StoreOpener-15427b4f939a97260e6bd2e474ae1780-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,535 DEBUG [StoreOpener-15427b4f939a97260e6bd2e474ae1780-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780/l 2023-10-04 06:59:30,535 DEBUG [StoreOpener-15427b4f939a97260e6bd2e474ae1780-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780/l 2023-10-04 06:59:30,535 INFO [StoreOpener-15427b4f939a97260e6bd2e474ae1780-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15427b4f939a97260e6bd2e474ae1780 columnFamilyName l 2023-10-04 06:59:30,537 INFO [StoreOpener-15427b4f939a97260e6bd2e474ae1780-1] regionserver.HStore(310): Store=15427b4f939a97260e6bd2e474ae1780/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:30,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 15427b4f939a97260e6bd2e474ae1780 2023-10-04 06:59:30,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 06:59:30,552 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 15427b4f939a97260e6bd2e474ae1780; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68731722, jitterRate=0.02418246865272522}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 06:59:30,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 15427b4f939a97260e6bd2e474ae1780: 2023-10-04 06:59:30,554 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780., pid=11, masterSystemTime=1696402770521 2023-10-04 06:59:30,557 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 06:59:30,557 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 06:59:30,559 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=15427b4f939a97260e6bd2e474ae1780, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:30,559 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696402770559"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402770559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402770559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402770559"}]},"ts":"1696402770559"} 2023-10-04 06:59:30,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-04 06:59:30,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 15427b4f939a97260e6bd2e474ae1780, server=jenkins-hbase20.apache.org,32841,1696402767186 in 196 msec 2023-10-04 06:59:30,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-04 06:59:30,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=15427b4f939a97260e6bd2e474ae1780, ASSIGN in 361 msec 2023-10-04 06:59:30,574 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 06:59:30,574 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402770574"}]},"ts":"1696402770574"} 2023-10-04 06:59:30,577 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-04 06:59:30,580 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 06:59:30,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 480 msec 2023-10-04 06:59:30,726 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 06:59:30,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-04 06:59:30,736 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-04 06:59:31,305 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 06:59:31,599 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 06:59:31,605 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_37169_jobhistory____.uqkktv/webapp 2023-10-04 06:59:31,748 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-04 06:59:31,748 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-04 06:59:31,748 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 06:59:31,751 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 06:59:31,825 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:32,116 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:32,397 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-04 06:59:32,426 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:37169 2023-10-04 06:59:32,801 WARN [Listener at jenkins-hbase20.apache.org/43635] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 06:59:33,050 WARN [Listener at jenkins-hbase20.apache.org/43635] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 06:59:33,050 INFO [Listener at jenkins-hbase20.apache.org/43635] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 06:59:33,058 INFO [Listener at jenkins-hbase20.apache.org/43635] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_39735_cluster____.rjrib/webapp 2023-10-04 06:59:33,118 INFO [Listener at jenkins-hbase20.apache.org/43635] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 06:59:33,118 INFO [Listener at jenkins-hbase20.apache.org/43635] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-04 06:59:33,119 INFO [Listener at jenkins-hbase20.apache.org/43635] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 06:59:33,119 INFO [Listener at jenkins-hbase20.apache.org/43635] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 06:59:33,128 INFO [Listener at jenkins-hbase20.apache.org/43635] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:33,332 INFO [Listener at jenkins-hbase20.apache.org/43635] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:33,409 INFO [Listener at jenkins-hbase20.apache.org/43635] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:33,419 INFO [Listener at jenkins-hbase20.apache.org/43635] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:39735 2023-10-04 06:59:33,822 WARN [Listener at jenkins-hbase20.apache.org/37871] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 06:59:33,844 WARN [Listener at jenkins-hbase20.apache.org/37871] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 06:59:33,845 INFO [Listener at jenkins-hbase20.apache.org/37871] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 06:59:33,852 INFO [Listener at jenkins-hbase20.apache.org/37871] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_44807_node____.go72b3/webapp 2023-10-04 06:59:33,898 INFO [Listener at jenkins-hbase20.apache.org/37871] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-04 06:59:33,898 INFO [Listener at jenkins-hbase20.apache.org/37871] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 06:59:33,898 INFO [Listener at jenkins-hbase20.apache.org/37871] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 06:59:33,898 INFO [Listener at jenkins-hbase20.apache.org/37871] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 06:59:33,910 INFO [Listener at jenkins-hbase20.apache.org/37871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:33,930 INFO [Listener at jenkins-hbase20.apache.org/37871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:34,001 INFO [Listener at jenkins-hbase20.apache.org/37871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:34,011 INFO [Listener at jenkins-hbase20.apache.org/37871] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:44807 2023-10-04 06:59:34,188 WARN [Listener at jenkins-hbase20.apache.org/37865] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 06:59:34,194 WARN [Listener at jenkins-hbase20.apache.org/37865] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 06:59:34,195 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 06:59:34,202 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_44231_node____.nwxoke/webapp 2023-10-04 06:59:34,246 INFO [Listener at jenkins-hbase20.apache.org/37865] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-04 06:59:34,246 INFO [Listener at jenkins-hbase20.apache.org/37865] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 06:59:34,247 INFO [Listener at jenkins-hbase20.apache.org/37865] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 06:59:34,247 INFO [Listener at jenkins-hbase20.apache.org/37865] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 06:59:34,256 INFO [Listener at jenkins-hbase20.apache.org/37865] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:34,269 INFO [Listener at jenkins-hbase20.apache.org/37865] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:34,327 INFO [Listener at jenkins-hbase20.apache.org/37865] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 06:59:34,332 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:44231 2023-10-04 06:59:34,353 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-04 06:59:34,354 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 06:59:34,421 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=215, ProcessCount=163, AvailableMemoryMB=3508 2023-10-04 06:59:34,422 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-10-04 06:59:34,440 DEBUG [Listener at jenkins-hbase20.apache.org/37865] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-04 06:59:34,446 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-04 06:59:34,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 06:59:34,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-04 06:59:34,461 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 06:59:34,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-04 06:59:34,465 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 06:59:34,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 06:59:34,470 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,470 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,471 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2 empty. 2023-10-04 06:59:34,473 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374 empty. 2023-10-04 06:59:34,474 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,474 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,474 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-04 06:59:34,512 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-04 06:59:34,515 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b983742a3621c819c78efd4976ea7c2, NAME => 'testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 06:59:34,515 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b18effb0361ed2dac483c00a622da374, NAME => 'testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 06:59:34,554 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:34,555 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5b983742a3621c819c78efd4976ea7c2, disabling compactions & flushes 2023-10-04 06:59:34,556 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:34,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:34,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. after waiting 0 ms 2023-10-04 06:59:34,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:34,556 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:34,556 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5b983742a3621c819c78efd4976ea7c2: 2023-10-04 06:59:34,558 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:34,560 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b18effb0361ed2dac483c00a622da374, disabling compactions & flushes 2023-10-04 06:59:34,560 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:34,560 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:34,560 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. after waiting 0 ms 2023-10-04 06:59:34,560 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:34,560 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:34,560 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b18effb0361ed2dac483c00a622da374: 2023-10-04 06:59:34,566 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 06:59:34,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 06:59:34,567 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402774567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402774567"}]},"ts":"1696402774567"} 2023-10-04 06:59:34,567 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402774567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402774567"}]},"ts":"1696402774567"} 2023-10-04 06:59:34,608 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 06:59:34,609 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 06:59:34,610 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402774609"}]},"ts":"1696402774609"} 2023-10-04 06:59:34,612 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-04 06:59:34,616 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 06:59:34,618 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 06:59:34,618 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 06:59:34,618 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 06:59:34,618 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 06:59:34,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b983742a3621c819c78efd4976ea7c2, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18effb0361ed2dac483c00a622da374, ASSIGN}] 2023-10-04 06:59:34,621 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18effb0361ed2dac483c00a622da374, ASSIGN 2023-10-04 06:59:34,621 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b983742a3621c819c78efd4976ea7c2, ASSIGN 2023-10-04 06:59:34,622 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b983742a3621c819c78efd4976ea7c2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44825,1696402767278; forceNewPlan=false, retain=false 2023-10-04 06:59:34,622 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18effb0361ed2dac483c00a622da374, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45271,1696402767235; forceNewPlan=false, retain=false 2023-10-04 06:59:34,664 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 06:59:34,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 06:59:34,773 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 06:59:34,775 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5b983742a3621c819c78efd4976ea7c2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:34,775 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b18effb0361ed2dac483c00a622da374, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:34,775 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402774774"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402774774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402774774"}]},"ts":"1696402774774"} 2023-10-04 06:59:34,775 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402774774"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402774774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402774774"}]},"ts":"1696402774774"} 2023-10-04 06:59:34,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 5b983742a3621c819c78efd4976ea7c2, server=jenkins-hbase20.apache.org,44825,1696402767278}] 2023-10-04 06:59:34,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure b18effb0361ed2dac483c00a622da374, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 06:59:34,839 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-04 06:59:34,840 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-04 06:59:34,841 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-04 06:59:34,941 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:34,941 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 06:59:34,943 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 06:59:34,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:34,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b983742a3621c819c78efd4976ea7c2, NAME => 'testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b18effb0361ed2dac483c00a622da374, NAME => 'testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. service=AccessControlService 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. service=AccessControlService 2023-10-04 06:59:34,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:34,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,952 INFO [StoreOpener-b18effb0361ed2dac483c00a622da374-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,952 INFO [StoreOpener-5b983742a3621c819c78efd4976ea7c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,954 DEBUG [StoreOpener-b18effb0361ed2dac483c00a622da374-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf 2023-10-04 06:59:34,954 DEBUG [StoreOpener-b18effb0361ed2dac483c00a622da374-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf 2023-10-04 06:59:34,954 DEBUG [StoreOpener-5b983742a3621c819c78efd4976ea7c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf 2023-10-04 06:59:34,954 DEBUG [StoreOpener-5b983742a3621c819c78efd4976ea7c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf 2023-10-04 06:59:34,957 INFO [StoreOpener-b18effb0361ed2dac483c00a622da374-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b18effb0361ed2dac483c00a622da374 columnFamilyName cf 2023-10-04 06:59:34,957 INFO [StoreOpener-5b983742a3621c819c78efd4976ea7c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b983742a3621c819c78efd4976ea7c2 columnFamilyName cf 2023-10-04 06:59:34,959 INFO [StoreOpener-5b983742a3621c819c78efd4976ea7c2-1] regionserver.HStore(310): Store=5b983742a3621c819c78efd4976ea7c2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:34,959 INFO [StoreOpener-b18effb0361ed2dac483c00a622da374-1] regionserver.HStore(310): Store=b18effb0361ed2dac483c00a622da374/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:34,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:34,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:34,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 06:59:34,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 06:59:34,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5b983742a3621c819c78efd4976ea7c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60836928, jitterRate=-0.0934591293334961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 06:59:34,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b18effb0361ed2dac483c00a622da374; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66050020, jitterRate=-0.015778005123138428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 06:59:34,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5b983742a3621c819c78efd4976ea7c2: 2023-10-04 06:59:34,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b18effb0361ed2dac483c00a622da374: 2023-10-04 06:59:34,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2., pid=15, masterSystemTime=1696402774941 2023-10-04 06:59:34,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374., pid=16, masterSystemTime=1696402774942 2023-10-04 06:59:34,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:34,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:34,988 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b18effb0361ed2dac483c00a622da374, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:34,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:34,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:34,989 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402774987"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402774987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402774987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402774987"}]},"ts":"1696402774987"} 2023-10-04 06:59:34,990 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5b983742a3621c819c78efd4976ea7c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:34,990 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402774990"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402774990"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402774990"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402774990"}]},"ts":"1696402774990"} 2023-10-04 06:59:34,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-04 06:59:34,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure b18effb0361ed2dac483c00a622da374, server=jenkins-hbase20.apache.org,45271,1696402767235 in 203 msec 2023-10-04 06:59:35,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-04 06:59:35,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 5b983742a3621c819c78efd4976ea7c2, server=jenkins-hbase20.apache.org,44825,1696402767278 in 207 msec 2023-10-04 06:59:35,003 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18effb0361ed2dac483c00a622da374, ASSIGN in 381 msec 2023-10-04 06:59:35,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-04 06:59:35,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b983742a3621c819c78efd4976ea7c2, ASSIGN in 384 msec 2023-10-04 06:59:35,007 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 06:59:35,007 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402775007"}]},"ts":"1696402775007"} 2023-10-04 06:59:35,010 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-04 06:59:35,013 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 06:59:35,019 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-04 06:59:35,038 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 06:59:35,063 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:35,063 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:35,063 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:35,063 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:35,063 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 06:59:35,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 06:59:35,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 06:59:35,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 06:59:35,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 06:59:35,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 06:59:35,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 615 msec 2023-10-04 06:59:35,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 06:59:35,573 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-04 06:59:35,577 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-04 06:59:35,577 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:35,579 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 06:59:35,602 DEBUG [hconnection-0x178bf7aa-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:35,606 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:35,610 DEBUG [hconnection-0x178bf7aa-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:35,613 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:35,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 06:59:35,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402775627 (current time:1696402775627). 2023-10-04 06:59:35,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 06:59:35,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x5139002a to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:35,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23a5eff6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:35,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:35,638 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:35,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5139002a to 127.0.0.1:49707 2023-10-04 06:59:35,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 06:59:35,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x5826d077 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:35,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f865561, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:35,651 DEBUG [hconnection-0x4be75faf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:35,653 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:35,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5826d077 to 127.0.0.1:49707 2023-10-04 06:59:35,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 06:59:35,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 06:59:35,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 06:59:35,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 06:59:35,691 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 06:59:35,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 06:59:35,710 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 06:59:35,711 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696403375711 2023-10-04 06:59:35,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 06:59:35,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-04 06:59:35,716 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 06:59:35,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 06:59:35,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-04 06:59:35,719 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 06:59:35,721 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696403375721 2023-10-04 06:59:35,721 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 06:59:35,721 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 06:59:35,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,753 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-04 06:59:35,753 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:35,754 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-04 06:59:35,754 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-04 06:59:35,755 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,755 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,758 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:35,758 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:35,758 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:35,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:35,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:35,758 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:35,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:35,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:35,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,759 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,759 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,759 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,759 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 06:59:35,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 06:59:35,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 06:59:35,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,767 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 06:59:35,767 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 06:59:35,767 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:35,767 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 06:59:35,768 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:35,767 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:35,769 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 06:59:35,768 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 06:59:35,771 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 06:59:35,771 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 06:59:35,770 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 06:59:35,771 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 06:59:35,771 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 06:59:35,771 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 06:59:35,771 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 06:59:35,773 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,773 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,774 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,774 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,774 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:35,774 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,774 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:35,774 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,774 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:35,774 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:35,774 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:35,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-04 06:59:35,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d7ccae8[Count = 1] remaining members to acquire global barrier 2023-10-04 06:59:35,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:35,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:35,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:35,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:35,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:35,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-04 06:59:35,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d7ccae8[Count = 0] remaining members to acquire global barrier 2023-10-04 06:59:35,779 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-04 06:59:35,779 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,781 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,781 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,781 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,781 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,782 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 06:59:35,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,782 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 06:59:35,782 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 06:59:35,782 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 06:59:35,782 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,782 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 06:59:35,782 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 06:59:35,784 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 06:59:35,784 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:35,784 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 06:59:35,784 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 06:59:35,785 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:35,785 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 06:59:35,785 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. started... 2023-10-04 06:59:35,787 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 06:59:35,789 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:35,789 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 06:59:35,789 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. started... 2023-10-04 06:59:35,790 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b18effb0361ed2dac483c00a622da374: 2023-10-04 06:59:35,790 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b983742a3621c819c78efd4976ea7c2: 2023-10-04 06:59:35,791 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,791 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,796 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 06:59:35,796 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 06:59:35,799 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 06:59:35,799 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 06:59:35,822 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:35,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 06:59:35,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 06:59:35,839 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 06:59:35,846 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. completed. 2023-10-04 06:59:35,846 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:35,846 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. completed. 2023-10-04 06:59:35,846 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 06:59:35,847 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 06:59:35,848 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 06:59:35,848 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,848 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,848 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 06:59:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:35,851 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 06:59:35,851 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:35,851 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,851 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 06:59:35,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:35,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:35,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:35,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 06:59:35,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-04 06:59:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44825,1696402767278': 2023-10-04 06:59:35,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-04 06:59:35,860 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-04 06:59:35,860 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 06:59:35,860 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 06:59:35,860 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,861 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 06:59:35,864 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:35,864 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:35,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:35,865 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:35,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,865 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,865 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:35,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:35,867 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,868 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,868 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,880 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,880 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:35,880 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:35,880 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:35,880 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:35,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:35,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:35,880 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,881 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,881 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,880 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:35,881 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:35,881 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:35,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:35,881 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:35,881 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:35,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:35,881 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:35,882 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:35,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,883 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:35,883 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-04 06:59:35,883 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 06:59:35,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:35,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 06:59:35,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-04 06:59:35,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,965 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:35,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696402775712Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696402775906 (+194 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696402775906Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696402775907 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696402775922 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696402775949 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696402775964 (+15 ms) 2023-10-04 06:59:35,968 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 06:59:35,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 254 msec 2023-10-04 06:59:36,042 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:36,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 06:59:36,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 06:59:36,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44825] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 06:59:36,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45271] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 06:59:36,066 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-04 06:59:36,067 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:36,067 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 06:59:36,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 06:59:36,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402776085 (current time:1696402776085). 2023-10-04 06:59:36,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 06:59:36,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x3e78dcaf to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:36,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6555902a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:36,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:36,096 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:36,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e78dcaf to 127.0.0.1:49707 2023-10-04 06:59:36,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 06:59:36,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x7f1b1756 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:36,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fe21be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:36,111 DEBUG [hconnection-0x4e6335ab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:36,114 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:36,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f1b1756 to 127.0.0.1:49707 2023-10-04 06:59:36,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 06:59:36,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 06:59:36,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 06:59:36,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 06:59:36,124 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 06:59:36,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 06:59:36,128 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 06:59:36,130 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696403376130 2023-10-04 06:59:36,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 06:59:36,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-04 06:59:36,132 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 06:59:36,132 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 06:59:36,133 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 06:59:36,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 06:59:36,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-10-04 06:59:36,137 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 06:59:36,138 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696403376138 2023-10-04 06:59:36,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-04 06:59:36,162 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-04 06:59:36,162 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:36,163 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-04 06:59:36,163 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-04 06:59:36,164 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,164 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,165 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:36,165 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:36,165 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:36,165 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:36,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:36,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:36,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:36,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:36,166 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:36,166 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,166 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,166 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 06:59:36,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 06:59:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 06:59:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 06:59:36,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 06:59:36,171 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:36,172 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 06:59:36,173 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 06:59:36,171 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 06:59:36,174 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:36,173 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 06:59:36,175 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 06:59:36,173 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 06:59:36,175 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 06:59:36,175 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 06:59:36,175 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 06:59:36,175 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 06:59:36,178 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,179 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,179 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,179 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:36,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:36,179 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,179 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,179 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,179 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:36,179 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:36,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:36,179 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,179 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:36,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:36,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:36,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-04 06:59:36,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ff83d29[Count = 1] remaining members to acquire global barrier 2023-10-04 06:59:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:36,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-04 06:59:36,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ff83d29[Count = 0] remaining members to acquire global barrier 2023-10-04 06:59:36,184 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-04 06:59:36,184 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,185 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 06:59:36,186 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,186 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 06:59:36,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,186 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 06:59:36,186 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 06:59:36,186 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 06:59:36,186 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 06:59:36,186 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,186 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 06:59:36,186 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:36,186 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 06:59:36,187 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. started... 2023-10-04 06:59:36,187 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b18effb0361ed2dac483c00a622da374 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-04 06:59:36,191 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 06:59:36,193 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:36,193 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 06:59:36,193 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. started... 2023-10-04 06:59:36,193 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 06:59:36,193 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:36,193 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 06:59:36,194 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b983742a3621c819c78efd4976ea7c2 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-04 06:59:36,232 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:36,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 06:59:36,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 06:59:36,234 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 06:59:36,257 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 06:59:36,258 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-04 06:59:36,258 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 06:59:36,258 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-04 06:59:36,259 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 06:59:36,259 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-04 06:59:36,259 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 06:59:36,259 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-04 06:59:36,259 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 06:59:36,259 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-04 06:59:36,323 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004bd56c34b371d41a78382040c439eb26d to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004bd56c34b371d41a78382040c439eb26d 2023-10-04 06:59:36,323 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310042f9749bc04f1418eb304f9b0a1eb320a to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310042f9749bc04f1418eb304f9b0a1eb320a 2023-10-04 06:59:36,351 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/.tmp/cf/2e269da203584f1abc1b9da3c8829492 2023-10-04 06:59:36,353 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/.tmp/cf/db9569fa7d1445648532c4ba07d9ff60 2023-10-04 06:59:36,364 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/.tmp/cf/2e269da203584f1abc1b9da3c8829492 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf/2e269da203584f1abc1b9da3c8829492 2023-10-04 06:59:36,364 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/.tmp/cf/db9569fa7d1445648532c4ba07d9ff60 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf/db9569fa7d1445648532c4ba07d9ff60 2023-10-04 06:59:36,373 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf/db9569fa7d1445648532c4ba07d9ff60, entries=46, sequenceid=6, filesize=12.6 K 2023-10-04 06:59:36,373 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf/2e269da203584f1abc1b9da3c8829492, entries=4, sequenceid=6, filesize=5.6 K 2023-10-04 06:59:36,377 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5b983742a3621c819c78efd4976ea7c2 in 183ms, sequenceid=6, compaction requested=false 2023-10-04 06:59:36,377 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for b18effb0361ed2dac483c00a622da374 in 190ms, sequenceid=6, compaction requested=false 2023-10-04 06:59:36,377 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-04 06:59:36,377 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-04 06:59:36,379 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b18effb0361ed2dac483c00a622da374: 2023-10-04 06:59:36,379 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b983742a3621c819c78efd4976ea7c2: 2023-10-04 06:59:36,380 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 06:59:36,380 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 06:59:36,380 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 06:59:36,380 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 06:59:36,380 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf/db9569fa7d1445648532c4ba07d9ff60] hfiles 2023-10-04 06:59:36,380 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf/2e269da203584f1abc1b9da3c8829492] hfiles 2023-10-04 06:59:36,381 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf/db9569fa7d1445648532c4ba07d9ff60 for snapshot=snaptb0-testExportWithTargetName 2023-10-04 06:59:36,381 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf/2e269da203584f1abc1b9da3c8829492 for snapshot=snaptb0-testExportWithTargetName 2023-10-04 06:59:36,434 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:36,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 06:59:36,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 06:59:36,436 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 06:59:36,737 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:36,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 06:59:36,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 06:59:36,739 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-04 06:59:36,805 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. completed. 2023-10-04 06:59:36,805 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. completed. 2023-10-04 06:59:36,805 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:36,805 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:36,805 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 06:59:36,805 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 06:59:36,805 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,805 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 06:59:36,805 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 06:59:36,805 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,805 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 06:59:36,806 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 06:59:36,806 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 06:59:36,806 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 06:59:36,807 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 06:59:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 06:59:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:36,807 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 06:59:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:36,809 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 06:59:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:36,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:36,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:36,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 06:59:36,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-04 06:59:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44825,1696402767278': 2023-10-04 06:59:36,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-04 06:59:36,819 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-04 06:59:36,819 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 06:59:36,819 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 06:59:36,819 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-04 06:59:36,819 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 06:59:36,822 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:36,822 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:36,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,822 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:36,823 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,823 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:36,824 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:36,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 06:59:36,826 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,827 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,827 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,838 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,838 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:36,838 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:36,838 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:36,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:36,838 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:36,838 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:36,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:36,838 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:36,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-04 06:59:36,838 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:36,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-04 06:59:36,838 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:36,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:36,839 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:36,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 06:59:36,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:36,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 06:59:36,840 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:36,841 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,841 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:36,841 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,841 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:36,841 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:36,841 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,841 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310042f9749bc04f1418eb304f9b0a1eb320a, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004bd56c34b371d41a78382040c439eb26d] mob files 2023-10-04 06:59:36,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310042f9749bc04f1418eb304f9b0a1eb320a 2023-10-04 06:59:36,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004bd56c34b371d41a78382040c439eb26d 2023-10-04 06:59:36,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-04 06:59:36,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-04 06:59:36,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,901 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 06:59:36,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696402776130Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696402776860 (+730 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696402776860Loading Region manifests for snaptb0-testExportWithTargetName at 1696402776860Writing data manifest for snaptb0-testExportWithTargetName at 1696402776867 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696402776889 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696402776900 (+11 ms) 2023-10-04 06:59:36,903 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 06:59:36,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 772 msec 2023-10-04 06:59:37,239 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:37,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 06:59:37,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 06:59:37,242 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242 2023-10-04 06:59:37,243 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34823, tgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242, rawTgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242, srcFsUri=hdfs://localhost:34823, srcDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 06:59:37,285 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 06:59:37,286 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-390078867_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-04 06:59:37,286 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840, snapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-04 06:59:37,313 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-04 06:59:37,387 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:37,387 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:37,388 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:37,389 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,193 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-2655080139773094914.jar 2023-10-04 06:59:38,194 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,194 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,251 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-1466660429930676818.jar 2023-10-04 06:59:38,251 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,252 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,252 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,253 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,253 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,253 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:38,254 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 06:59:38,254 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 06:59:38,255 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 06:59:38,255 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 06:59:38,255 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 06:59:38,256 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 06:59:38,256 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 06:59:38,256 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 06:59:38,257 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 06:59:38,257 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 06:59:38,260 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 06:59:38,261 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 06:59:38,261 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 06:59:38,261 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 06:59:38,261 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 06:59:38,262 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 06:59:38,262 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 06:59:38,912 WARN [Listener at jenkins-hbase20.apache.org/37865] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 06:59:38,920 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-04 06:59:38,930 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-04 06:59:39,324 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 06:59:39,325 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 06:59:39,488 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0001_000001 (auth:SIMPLE) 2023-10-04 06:59:40,455 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 06:59:43,383 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0001_000001 (auth:SIMPLE) 2023-10-04 06:59:45,622 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0001_000001 (auth:SIMPLE) 2023-10-04 06:59:48,446 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0001_000001 (auth:SIMPLE) 2023-10-04 06:59:49,736 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 06:59:49,740 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 06:59:49,751 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-04 06:59:49,751 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 06:59:49,752 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 06:59:49,752 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-04 06:59:49,752 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-04 06:59:49,752 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-04 06:59:49,753 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242/.hbase-snapshot/testExportWithTargetName 2023-10-04 06:59:49,753 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-04 06:59:49,753 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402777242/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-04 06:59:49,765 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-04 06:59:49,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-10-04 06:59:49,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-04 06:59:49,790 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402789790"}]},"ts":"1696402789790"} 2023-10-04 06:59:49,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 06:59:49,793 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-04 06:59:49,794 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-04 06:59:49,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b983742a3621c819c78efd4976ea7c2, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18effb0361ed2dac483c00a622da374, UNASSIGN}] 2023-10-04 06:59:49,799 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b983742a3621c819c78efd4976ea7c2, UNASSIGN 2023-10-04 06:59:49,800 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18effb0361ed2dac483c00a622da374, UNASSIGN 2023-10-04 06:59:49,801 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5b983742a3621c819c78efd4976ea7c2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:49,801 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b18effb0361ed2dac483c00a622da374, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:49,801 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402789801"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402789801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402789801"}]},"ts":"1696402789801"} 2023-10-04 06:59:49,801 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402789801"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402789801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402789801"}]},"ts":"1696402789801"} 2023-10-04 06:59:49,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5b983742a3621c819c78efd4976ea7c2, server=jenkins-hbase20.apache.org,44825,1696402767278}] 2023-10-04 06:59:49,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure b18effb0361ed2dac483c00a622da374, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 06:59:49,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 06:59:49,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:49,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:49,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b18effb0361ed2dac483c00a622da374, disabling compactions & flushes 2023-10-04 06:59:49,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5b983742a3621c819c78efd4976ea7c2, disabling compactions & flushes 2023-10-04 06:59:49,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:49,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:49,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:49,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:49,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. after waiting 0 ms 2023-10-04 06:59:49,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:49,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. after waiting 0 ms 2023-10-04 06:59:49,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:49,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 06:59:49,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 06:59:49,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 06:59:49,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 06:59:49,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374. 2023-10-04 06:59:49,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2. 2023-10-04 06:59:49,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b18effb0361ed2dac483c00a622da374: 2023-10-04 06:59:49,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5b983742a3621c819c78efd4976ea7c2: 2023-10-04 06:59:49,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:49,994 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b18effb0361ed2dac483c00a622da374, regionState=CLOSED 2023-10-04 06:59:49,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:49,995 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402789994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402789994"}]},"ts":"1696402789994"} 2023-10-04 06:59:49,996 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5b983742a3621c819c78efd4976ea7c2, regionState=CLOSED 2023-10-04 06:59:49,996 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696402789996"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402789996"}]},"ts":"1696402789996"} 2023-10-04 06:59:50,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-04 06:59:50,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure b18effb0361ed2dac483c00a622da374, server=jenkins-hbase20.apache.org,45271,1696402767235 in 192 msec 2023-10-04 06:59:50,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-04 06:59:50,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5b983742a3621c819c78efd4976ea7c2, server=jenkins-hbase20.apache.org,44825,1696402767278 in 194 msec 2023-10-04 06:59:50,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b18effb0361ed2dac483c00a622da374, UNASSIGN in 204 msec 2023-10-04 06:59:50,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-04 06:59:50,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b983742a3621c819c78efd4976ea7c2, UNASSIGN in 205 msec 2023-10-04 06:59:50,005 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402790005"}]},"ts":"1696402790005"} 2023-10-04 06:59:50,007 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-04 06:59:50,008 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-04 06:59:50,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 234 msec 2023-10-04 06:59:50,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 06:59:50,094 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-04 06:59:50,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-10-04 06:59:50,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 06:59:50,108 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 06:59:50,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-04 06:59:50,110 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 06:59:50,117 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-04 06:59:50,119 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 06:59:50,119 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 06:59:50,119 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 06:59:50,119 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 06:59:50,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-04 06:59:50,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-04 06:59:50,121 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:50,121 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:50,122 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 06:59:50,122 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:50,122 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:50,122 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:50,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 06:59:50,123 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 06:59:50,123 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 06:59:50,123 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 06:59:50,123 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 06:59:50,123 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:50,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-04 06:59:50,126 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/recovered.edits] 2023-10-04 06:59:50,126 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/recovered.edits] 2023-10-04 06:59:50,133 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf/2e269da203584f1abc1b9da3c8829492 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/cf/2e269da203584f1abc1b9da3c8829492 2023-10-04 06:59:50,134 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf/db9569fa7d1445648532c4ba07d9ff60 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/cf/db9569fa7d1445648532c4ba07d9ff60 2023-10-04 06:59:50,137 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2/recovered.edits/9.seqid 2023-10-04 06:59:50,137 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374/recovered.edits/9.seqid 2023-10-04 06:59:50,138 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/5b983742a3621c819c78efd4976ea7c2 2023-10-04 06:59:50,138 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportWithTargetName/b18effb0361ed2dac483c00a622da374 2023-10-04 06:59:50,138 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-04 06:59:50,139 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-04 06:59:50,140 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-04 06:59:50,144 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310042f9749bc04f1418eb304f9b0a1eb320a to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310042f9749bc04f1418eb304f9b0a1eb320a 2023-10-04 06:59:50,145 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004bd56c34b371d41a78382040c439eb26d to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004bd56c34b371d41a78382040c439eb26d 2023-10-04 06:59:50,146 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-04 06:59:50,149 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 06:59:50,169 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-04 06:59:50,172 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-04 06:59:50,173 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 06:59:50,173 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-04 06:59:50,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402790174"}]},"ts":"9223372036854775807"} 2023-10-04 06:59:50,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402790174"}]},"ts":"9223372036854775807"} 2023-10-04 06:59:50,176 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 06:59:50,176 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b983742a3621c819c78efd4976ea7c2, NAME => 'testtb-testExportWithTargetName,,1696402774454.5b983742a3621c819c78efd4976ea7c2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b18effb0361ed2dac483c00a622da374, NAME => 'testtb-testExportWithTargetName,1,1696402774454.b18effb0361ed2dac483c00a622da374.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 06:59:50,177 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-04 06:59:50,177 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696402790177"}]},"ts":"9223372036854775807"} 2023-10-04 06:59:50,179 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-04 06:59:50,181 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 06:59:50,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-10-04 06:59:50,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-04 06:59:50,229 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-04 06:59:50,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-04 06:59:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-04 06:59:50,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-10-04 06:59:50,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-04 06:59:50,285 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=758 (was 708) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1727789539_1 at /127.0.0.1:36922 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:42995 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:45264 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:42722 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:38283 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:37865 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:37871 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1727789539_1 at /127.0.0.1:45250 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 215) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=2772 (was 3508) 2023-10-04 06:59:50,285 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-04 06:59:50,301 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=166, AvailableMemoryMB=2771 2023-10-04 06:59:50,301 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-04 06:59:50,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 06:59:50,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-04 06:59:50,308 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 06:59:50,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-04 06:59:50,311 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 06:59:50,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 06:59:50,314 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,314 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,315 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526 empty. 2023-10-04 06:59:50,315 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243 empty. 2023-10-04 06:59:50,315 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,315 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,315 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-04 06:59:50,327 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-04 06:59:50,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 70bdf6558089e4f79688284f6987a526, NAME => 'testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 06:59:50,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3887cdbafec7b0dabebffed4f6f2d243, NAME => 'testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 06:59:50,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:50,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 3887cdbafec7b0dabebffed4f6f2d243, disabling compactions & flushes 2023-10-04 06:59:50,346 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:50,346 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:50,346 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. after waiting 0 ms 2023-10-04 06:59:50,346 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:50,346 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:50,346 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 3887cdbafec7b0dabebffed4f6f2d243: 2023-10-04 06:59:50,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:50,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 70bdf6558089e4f79688284f6987a526, disabling compactions & flushes 2023-10-04 06:59:50,350 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:50,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:50,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. after waiting 0 ms 2023-10-04 06:59:50,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:50,350 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:50,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 70bdf6558089e4f79688284f6987a526: 2023-10-04 06:59:50,353 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 06:59:50,354 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402790354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402790354"}]},"ts":"1696402790354"} 2023-10-04 06:59:50,354 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402790354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402790354"}]},"ts":"1696402790354"} 2023-10-04 06:59:50,357 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 06:59:50,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 06:59:50,359 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402790359"}]},"ts":"1696402790359"} 2023-10-04 06:59:50,361 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-04 06:59:50,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 06:59:50,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 06:59:50,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 06:59:50,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 06:59:50,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 06:59:50,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70bdf6558089e4f79688284f6987a526, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3887cdbafec7b0dabebffed4f6f2d243, ASSIGN}] 2023-10-04 06:59:50,371 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70bdf6558089e4f79688284f6987a526, ASSIGN 2023-10-04 06:59:50,371 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3887cdbafec7b0dabebffed4f6f2d243, ASSIGN 2023-10-04 06:59:50,372 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70bdf6558089e4f79688284f6987a526, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44825,1696402767278; forceNewPlan=false, retain=false 2023-10-04 06:59:50,372 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3887cdbafec7b0dabebffed4f6f2d243, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32841,1696402767186; forceNewPlan=false, retain=false 2023-10-04 06:59:50,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 06:59:50,522 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 06:59:50,525 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3887cdbafec7b0dabebffed4f6f2d243, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:50,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=70bdf6558089e4f79688284f6987a526, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:50,525 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402790525"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402790525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402790525"}]},"ts":"1696402790525"} 2023-10-04 06:59:50,526 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402790525"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402790525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402790525"}]},"ts":"1696402790525"} 2023-10-04 06:59:50,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 3887cdbafec7b0dabebffed4f6f2d243, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 06:59:50,529 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 70bdf6558089e4f79688284f6987a526, server=jenkins-hbase20.apache.org,44825,1696402767278}] 2023-10-04 06:59:50,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 06:59:50,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:50,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 70bdf6558089e4f79688284f6987a526, NAME => 'testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 06:59:50,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3887cdbafec7b0dabebffed4f6f2d243, NAME => 'testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 06:59:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. service=AccessControlService 2023-10-04 06:59:50,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. service=AccessControlService 2023-10-04 06:59:50,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 06:59:50,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 06:59:50,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,691 INFO [StoreOpener-70bdf6558089e4f79688284f6987a526-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,692 INFO [StoreOpener-3887cdbafec7b0dabebffed4f6f2d243-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,693 DEBUG [StoreOpener-70bdf6558089e4f79688284f6987a526-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf 2023-10-04 06:59:50,693 DEBUG [StoreOpener-70bdf6558089e4f79688284f6987a526-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf 2023-10-04 06:59:50,693 DEBUG [StoreOpener-3887cdbafec7b0dabebffed4f6f2d243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf 2023-10-04 06:59:50,693 DEBUG [StoreOpener-3887cdbafec7b0dabebffed4f6f2d243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf 2023-10-04 06:59:50,693 INFO [StoreOpener-70bdf6558089e4f79688284f6987a526-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70bdf6558089e4f79688284f6987a526 columnFamilyName cf 2023-10-04 06:59:50,694 INFO [StoreOpener-3887cdbafec7b0dabebffed4f6f2d243-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3887cdbafec7b0dabebffed4f6f2d243 columnFamilyName cf 2023-10-04 06:59:50,695 INFO [StoreOpener-70bdf6558089e4f79688284f6987a526-1] regionserver.HStore(310): Store=70bdf6558089e4f79688284f6987a526/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:50,695 INFO [StoreOpener-3887cdbafec7b0dabebffed4f6f2d243-1] regionserver.HStore(310): Store=3887cdbafec7b0dabebffed4f6f2d243/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 06:59:50,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 70bdf6558089e4f79688284f6987a526 2023-10-04 06:59:50,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 06:59:50,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 06:59:50,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 06:59:50,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3887cdbafec7b0dabebffed4f6f2d243; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70238491, jitterRate=0.04663507640361786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 06:59:50,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 70bdf6558089e4f79688284f6987a526; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59899816, jitterRate=-0.10742318630218506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 06:59:50,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3887cdbafec7b0dabebffed4f6f2d243: 2023-10-04 06:59:50,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 70bdf6558089e4f79688284f6987a526: 2023-10-04 06:59:50,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243., pid=30, masterSystemTime=1696402790680 2023-10-04 06:59:50,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526., pid=31, masterSystemTime=1696402790683 2023-10-04 06:59:50,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:50,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:50,709 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=70bdf6558089e4f79688284f6987a526, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:50,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:50,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:50,710 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402790709"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402790709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402790709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402790709"}]},"ts":"1696402790709"} 2023-10-04 06:59:50,710 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3887cdbafec7b0dabebffed4f6f2d243, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:50,710 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402790710"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402790710"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402790710"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402790710"}]},"ts":"1696402790710"} 2023-10-04 06:59:50,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-04 06:59:50,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 70bdf6558089e4f79688284f6987a526, server=jenkins-hbase20.apache.org,44825,1696402767278 in 183 msec 2023-10-04 06:59:50,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-04 06:59:50,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 3887cdbafec7b0dabebffed4f6f2d243, server=jenkins-hbase20.apache.org,32841,1696402767186 in 188 msec 2023-10-04 06:59:50,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70bdf6558089e4f79688284f6987a526, ASSIGN in 352 msec 2023-10-04 06:59:50,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-04 06:59:50,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3887cdbafec7b0dabebffed4f6f2d243, ASSIGN in 354 msec 2023-10-04 06:59:50,726 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 06:59:50,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402790726"}]},"ts":"1696402790726"} 2023-10-04 06:59:50,728 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-04 06:59:50,731 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 06:59:50,731 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-04 06:59:50,734 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 06:59:50,738 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:50,738 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:50,738 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:50,738 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 06:59:50,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 06:59:50,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 06:59:50,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 06:59:50,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 06:59:50,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 434 msec 2023-10-04 06:59:50,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 06:59:50,915 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-04 06:59:50,918 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-04 06:59:50,918 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:50,920 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 06:59:50,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 06:59:50,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402790936 (current time:1696402790936). 2023-10-04 06:59:50,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 06:59:50,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x17802ee6 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:50,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5594b3ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:50,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:50,947 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:50,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17802ee6 to 127.0.0.1:49707 2023-10-04 06:59:50,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 06:59:50,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x01331253 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:50,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1752fb8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:50,960 DEBUG [hconnection-0x67a9016e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:50,961 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:50,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01331253 to 127.0.0.1:49707 2023-10-04 06:59:50,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 06:59:50,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 06:59:50,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 06:59:50,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 06:59:50,974 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 06:59:50,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 06:59:50,978 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 06:59:50,979 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696403390979 2023-10-04 06:59:50,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-04 06:59:50,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 06:59:50,981 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 06:59:50,981 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 06:59:50,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 06:59:50,983 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 06:59:50,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-10-04 06:59:50,987 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 06:59:50,988 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696403390988 2023-10-04 06:59:50,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:50,998 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-04 06:59:50,998 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:51,000 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-04 06:59:51,000 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-04 06:59:51,000 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,001 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,001 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,001 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,001 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,001 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,002 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,002 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,003 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,003 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 06:59:51,003 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,003 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:51,004 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 06:59:51,005 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 06:59:51,005 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 06:59:51,005 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 06:59:51,005 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 06:59:51,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,029 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 06:59:51,029 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 06:59:51,029 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:51,029 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 06:59:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 06:59:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 06:59:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 06:59:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 06:59:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 06:59:51,032 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,032 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,034 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,034 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,034 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,035 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:51,034 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,035 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:51,034 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,035 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,035 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-04 06:59:51,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37c96b46[Count = 1] remaining members to acquire global barrier 2023-10-04 06:59:51,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-04 06:59:51,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37c96b46[Count = 0] remaining members to acquire global barrier 2023-10-04 06:59:51,038 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 06:59:51,039 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,039 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,039 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,039 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 06:59:51,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,040 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 06:59:51,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 06:59:51,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,040 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,040 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 06:59:51,040 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 06:59:51,040 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 06:59:51,040 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. started... 2023-10-04 06:59:51,040 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:51,041 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. started... 2023-10-04 06:59:51,042 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3887cdbafec7b0dabebffed4f6f2d243: 2023-10-04 06:59:51,042 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70bdf6558089e4f79688284f6987a526: 2023-10-04 06:59:51,042 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,042 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,042 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 06:59:51,042 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 06:59:51,043 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 06:59:51,042 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 06:59:51,043 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:51,043 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 06:59:51,043 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 06:59:51,069 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. completed. 2023-10-04 06:59:51,069 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:51,069 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. completed. 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 06:59:51,069 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 06:59:51,069 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 06:59:51,078 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 06:59:51,078 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:51,078 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 06:59:51,078 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,080 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 06:59:51,080 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,080 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:51,080 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 06:59:51,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,081 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:51,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 06:59:51,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 06:59:51,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,083 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 06:59:51,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,44825,1696402767278': 2023-10-04 06:59:51,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 06:59:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,32841,1696402767186': 2023-10-04 06:59:51,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 06:59:51,088 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-04 06:59:51,088 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 06:59:51,088 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 06:59:51,088 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,088 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 06:59:51,089 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,089 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,089 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,089 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,090 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,090 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,090 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,092 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,092 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,093 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,095 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,095 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,095 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,095 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,095 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,095 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:51,095 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-04 06:59:51,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 06:59:51,095 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,095 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,097 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,098 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,098 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,098 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,098 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,098 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,098 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,098 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,098 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 06:59:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,136 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-04 06:59:51,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,136 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 06:59:51,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696402790979Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696402791110 (+131 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696402791110Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696402791110Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696402791114 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696402791127 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696402791136 (+9 ms) 2023-10-04 06:59:51,138 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 06:59:51,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 157 msec 2023-10-04 06:59:51,283 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:51,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 06:59:51,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 06:59:51,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44825] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 06:59:51,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32841] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 06:59:51,297 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-04 06:59:51,297 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:51,297 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 06:59:51,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 06:59:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402791311 (current time:1696402791311). 2023-10-04 06:59:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 06:59:51,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x4834bf56 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:51,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6759a993, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:51,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:51,322 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:51,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4834bf56 to 127.0.0.1:49707 2023-10-04 06:59:51,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 06:59:51,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x00bd8363 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 06:59:51,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47a17b3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 06:59:51,331 DEBUG [hconnection-0x7a5ca62e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 06:59:51,334 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 06:59:51,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00bd8363 to 127.0.0.1:49707 2023-10-04 06:59:51,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 06:59:51,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 06:59:51,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 06:59:51,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 06:59:51,343 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 06:59:51,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 06:59:51,347 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 06:59:51,349 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696403391349 2023-10-04 06:59:51,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-04 06:59:51,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 06:59:51,351 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 06:59:51,351 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 06:59:51,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 06:59:51,353 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 06:59:51,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-10-04 06:59:51,357 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 06:59:51,358 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696403391358 2023-10-04 06:59:51,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-04 06:59:51,377 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-04 06:59:51,377 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:51,379 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-04 06:59:51,379 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-04 06:59:51,380 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,380 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,380 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,380 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,380 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,380 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,381 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,381 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,381 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,381 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 06:59:51,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 06:59:51,382 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 06:59:51,382 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 06:59:51,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 06:59:51,382 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:51,382 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:51,384 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 06:59:51,384 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 06:59:51,383 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 06:59:51,384 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 06:59:51,384 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 06:59:51,384 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 06:59:51,385 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 06:59:51,385 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 06:59:51,385 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 06:59:51,385 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 06:59:51,385 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 06:59:51,386 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,386 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,386 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,386 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,386 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,386 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,387 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:51,386 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,387 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,387 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,387 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 06:59:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-04 06:59:51,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f619e3[Count = 1] remaining members to acquire global barrier 2023-10-04 06:59:51,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-04 06:59:51,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f619e3[Count = 0] remaining members to acquire global barrier 2023-10-04 06:59:51,391 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 06:59:51,391 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 06:59:51,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,393 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,393 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 06:59:51,393 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 06:59:51,393 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:51,393 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 06:59:51,393 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:51,393 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 06:59:51,393 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. started... 2023-10-04 06:59:51,393 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 06:59:51,393 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 06:59:51,393 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 06:59:51,393 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 06:59:51,393 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 06:59:51,393 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. started... 2023-10-04 06:59:51,393 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 70bdf6558089e4f79688284f6987a526 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-04 06:59:51,393 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3887cdbafec7b0dabebffed4f6f2d243 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-04 06:59:51,394 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 06:59:51,394 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:51,394 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 06:59:51,421 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100406bf8178065441d2a7d721a4f3660ebe to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100406bf8178065441d2a7d721a4f3660ebe 2023-10-04 06:59:51,427 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231004a3ddf314fb9f4be2ab5093eb7bda21ec to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a3ddf314fb9f4be2ab5093eb7bda21ec 2023-10-04 06:59:51,442 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/.tmp/cf/701d5665c8dc4003861c3278974c49e7 2023-10-04 06:59:51,451 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:51,452 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/.tmp/cf/701d5665c8dc4003861c3278974c49e7 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf/701d5665c8dc4003861c3278974c49e7 2023-10-04 06:59:51,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 06:59:51,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 06:59:51,453 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 06:59:51,458 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf/701d5665c8dc4003861c3278974c49e7, entries=4, sequenceid=6, filesize=5.6 K 2023-10-04 06:59:51,459 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 70bdf6558089e4f79688284f6987a526 in 66ms, sequenceid=6, compaction requested=false 2023-10-04 06:59:51,459 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-04 06:59:51,459 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70bdf6558089e4f79688284f6987a526: 2023-10-04 06:59:51,460 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 06:59:51,460 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 06:59:51,460 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf/701d5665c8dc4003861c3278974c49e7] hfiles 2023-10-04 06:59:51,460 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf/701d5665c8dc4003861c3278974c49e7 for snapshot=snaptb0-testExportFileSystemState 2023-10-04 06:59:51,467 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. completed. 2023-10-04 06:59:51,467 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 06:59:51,467 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 06:59:51,467 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 06:59:51,467 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,467 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 06:59:51,467 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 06:59:51,470 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 06:59:51,470 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,470 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,470 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 06:59:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,44825,1696402767278': 2023-10-04 06:59:51,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 06:59:51,653 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:51,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 06:59:51,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 06:59:51,655 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 06:59:51,845 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/.tmp/cf/57b25d9e1b434aafad4c6a5ce95d6f87 2023-10-04 06:59:51,852 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/.tmp/cf/57b25d9e1b434aafad4c6a5ce95d6f87 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf/57b25d9e1b434aafad4c6a5ce95d6f87 2023-10-04 06:59:51,858 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf/57b25d9e1b434aafad4c6a5ce95d6f87, entries=46, sequenceid=6, filesize=12.7 K 2023-10-04 06:59:51,859 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 3887cdbafec7b0dabebffed4f6f2d243 in 466ms, sequenceid=6, compaction requested=false 2023-10-04 06:59:51,861 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3887cdbafec7b0dabebffed4f6f2d243: 2023-10-04 06:59:51,861 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 06:59:51,861 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 06:59:51,861 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf/57b25d9e1b434aafad4c6a5ce95d6f87] hfiles 2023-10-04 06:59:51,861 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf/57b25d9e1b434aafad4c6a5ce95d6f87 for snapshot=snaptb0-testExportFileSystemState 2023-10-04 06:59:51,875 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. completed. 2023-10-04 06:59:51,875 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 06:59:51,875 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 06:59:51,875 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 06:59:51,875 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,875 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 06:59:51,875 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 06:59:51,876 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 06:59:51,876 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,876 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:51,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,876 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 06:59:51,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,32841,1696402767186': 2023-10-04 06:59:51,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 06:59:51,881 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-04 06:59:51,881 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 06:59:51,881 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 06:59:51,881 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-04 06:59:51,881 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 06:59:51,896 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,896 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,896 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,896 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 06:59:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 06:59:51,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,897 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,897 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,897 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 06:59:51,897 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,898 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 06:59:51,898 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 06:59:51,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 06:59:51,900 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,900 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,900 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 06:59:51,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,905 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,905 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-04 06:59:51,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 06:59:51,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 06:59:51,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-04 06:59:51,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 06:59:51,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 06:59:51,905 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,908 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,908 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,908 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 06:59:51,908 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,908 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 06:59:51,908 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 06:59:51,908 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,908 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 06:59:51,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 06:59:51,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a3ddf314fb9f4be2ab5093eb7bda21ec, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100406bf8178065441d2a7d721a4f3660ebe] mob files 2023-10-04 06:59:51,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a3ddf314fb9f4be2ab5093eb7bda21ec 2023-10-04 06:59:51,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100406bf8178065441d2a7d721a4f3660ebe 2023-10-04 06:59:51,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-04 06:59:51,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-04 06:59:51,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,945 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696402791349Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696402791920 (+571 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696402791920Loading Region manifests for snaptb0-testExportFileSystemState at 1696402791920Writing data manifest for snaptb0-testExportFileSystemState at 1696402791927 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696402791936 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696402791945 (+9 ms) 2023-10-04 06:59:51,948 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 06:59:51,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 598 msec 2023-10-04 06:59:51,955 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 06:59:51,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 06:59:51,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 06:59:51,956 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956 2023-10-04 06:59:51,957 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34823, tgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956, rawTgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956, srcFsUri=hdfs://localhost:34823, srcDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 06:59:51,982 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 06:59:51,982 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1876585472_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 06:59:51,982 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840, snapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-04 06:59:51,998 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 06:59:52,025 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,026 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,027 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,027 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,767 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-7418172165519965442.jar 2023-10-04 06:59:52,768 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,768 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,824 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-4629105899553476445.jar 2023-10-04 06:59:52,824 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,824 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,825 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,825 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,825 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,826 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 06:59:52,826 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 06:59:52,826 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 06:59:52,827 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 06:59:52,827 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 06:59:52,827 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 06:59:52,828 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 06:59:52,828 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 06:59:52,828 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 06:59:52,829 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 06:59:52,829 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 06:59:52,830 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 06:59:52,830 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 06:59:52,830 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 06:59:52,830 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 06:59:52,831 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 06:59:52,831 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 06:59:52,832 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 06:59:53,307 WARN [Listener at jenkins-hbase20.apache.org/37865] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 06:59:53,309 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-04 06:59:53,313 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-04 06:59:54,641 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 06:59:54,641 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 06:59:54,646 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0001_000001 (auth:SIMPLE) 2023-10-04 06:59:55,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0002_000001 (auth:SIMPLE) 2023-10-04 06:59:55,569 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 06:59:59,074 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0002_000001 (auth:SIMPLE) 2023-10-04 07:00:01,269 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0002_000001 (auth:SIMPLE) 2023-10-04 07:00:03,538 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0002_000001 (auth:SIMPLE) 2023-10-04 07:00:03,551 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696402773467_0002_01_000002 is : 143 2023-10-04 07:00:05,539 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 07:00:05,540 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 07:00:05,547 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-04 07:00:05,547 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 07:00:05,548 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 07:00:05,548 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 07:00:05,548 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-04 07:00:05,548 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-04 07:00:05,549 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 07:00:05,549 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-04 07:00:05,549 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402791956/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-04 07:00:05,556 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-04 07:00:05,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-10-04 07:00:05,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-04 07:00:05,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 07:00:05,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402805561"}]},"ts":"1696402805561"} 2023-10-04 07:00:05,564 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-04 07:00:05,565 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-04 07:00:05,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70bdf6558089e4f79688284f6987a526, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3887cdbafec7b0dabebffed4f6f2d243, UNASSIGN}] 2023-10-04 07:00:05,568 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70bdf6558089e4f79688284f6987a526, UNASSIGN 2023-10-04 07:00:05,568 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3887cdbafec7b0dabebffed4f6f2d243, UNASSIGN 2023-10-04 07:00:05,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=70bdf6558089e4f79688284f6987a526, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:05,569 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3887cdbafec7b0dabebffed4f6f2d243, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:05,569 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402805569"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402805569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402805569"}]},"ts":"1696402805569"} 2023-10-04 07:00:05,569 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402805569"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402805569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402805569"}]},"ts":"1696402805569"} 2023-10-04 07:00:05,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 70bdf6558089e4f79688284f6987a526, server=jenkins-hbase20.apache.org,44825,1696402767278}] 2023-10-04 07:00:05,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 3887cdbafec7b0dabebffed4f6f2d243, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:00:05,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 07:00:05,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 70bdf6558089e4f79688284f6987a526 2023-10-04 07:00:05,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 70bdf6558089e4f79688284f6987a526, disabling compactions & flushes 2023-10-04 07:00:05,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 07:00:05,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 07:00:05,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. after waiting 0 ms 2023-10-04 07:00:05,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 07:00:05,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 07:00:05,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3887cdbafec7b0dabebffed4f6f2d243, disabling compactions & flushes 2023-10-04 07:00:05,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 07:00:05,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 07:00:05,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. after waiting 0 ms 2023-10-04 07:00:05,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 07:00:05,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:00:05,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:00:05,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:05,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:05,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526. 2023-10-04 07:00:05,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243. 2023-10-04 07:00:05,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 70bdf6558089e4f79688284f6987a526: 2023-10-04 07:00:05,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3887cdbafec7b0dabebffed4f6f2d243: 2023-10-04 07:00:05,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 07:00:05,737 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3887cdbafec7b0dabebffed4f6f2d243, regionState=CLOSED 2023-10-04 07:00:05,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 70bdf6558089e4f79688284f6987a526 2023-10-04 07:00:05,737 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402805737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402805737"}]},"ts":"1696402805737"} 2023-10-04 07:00:05,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=70bdf6558089e4f79688284f6987a526, regionState=CLOSED 2023-10-04 07:00:05,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696402805738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402805738"}]},"ts":"1696402805738"} 2023-10-04 07:00:05,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-04 07:00:05,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 3887cdbafec7b0dabebffed4f6f2d243, server=jenkins-hbase20.apache.org,32841,1696402767186 in 168 msec 2023-10-04 07:00:05,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-04 07:00:05,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 70bdf6558089e4f79688284f6987a526, server=jenkins-hbase20.apache.org,44825,1696402767278 in 169 msec 2023-10-04 07:00:05,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3887cdbafec7b0dabebffed4f6f2d243, UNASSIGN in 175 msec 2023-10-04 07:00:05,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-04 07:00:05,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70bdf6558089e4f79688284f6987a526, UNASSIGN in 175 msec 2023-10-04 07:00:05,744 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402805744"}]},"ts":"1696402805744"} 2023-10-04 07:00:05,745 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-04 07:00:05,746 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-04 07:00:05,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 191 msec 2023-10-04 07:00:05,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 07:00:05,863 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-04 07:00:05,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-10-04 07:00:05,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 07:00:05,867 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 07:00:05,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-04 07:00:05,868 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 07:00:05,869 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-04 07:00:05,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 07:00:05,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 07:00:05,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 07:00:05,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 07:00:05,871 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 07:00:05,871 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 07:00:05,872 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 07:00:05,872 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 07:00:05,872 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 07:00:05,872 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:05,872 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 07:00:05,872 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:05,872 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 07:00:05,872 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:05,872 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 07:00:05,872 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:05,873 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526 2023-10-04 07:00:05,873 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 07:00:05,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-04 07:00:05,875 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/recovered.edits] 2023-10-04 07:00:05,875 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/recovered.edits] 2023-10-04 07:00:05,878 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf/701d5665c8dc4003861c3278974c49e7 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/cf/701d5665c8dc4003861c3278974c49e7 2023-10-04 07:00:05,878 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf/57b25d9e1b434aafad4c6a5ce95d6f87 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/cf/57b25d9e1b434aafad4c6a5ce95d6f87 2023-10-04 07:00:05,881 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526/recovered.edits/9.seqid 2023-10-04 07:00:05,881 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243/recovered.edits/9.seqid 2023-10-04 07:00:05,882 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/70bdf6558089e4f79688284f6987a526 2023-10-04 07:00:05,883 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemState/3887cdbafec7b0dabebffed4f6f2d243 2023-10-04 07:00:05,883 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-04 07:00:05,883 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-04 07:00:05,884 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-04 07:00:05,887 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a3ddf314fb9f4be2ab5093eb7bda21ec to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a3ddf314fb9f4be2ab5093eb7bda21ec 2023-10-04 07:00:05,889 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100406bf8178065441d2a7d721a4f3660ebe to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100406bf8178065441d2a7d721a4f3660ebe 2023-10-04 07:00:05,889 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-04 07:00:05,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 07:00:05,903 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-04 07:00:05,905 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-04 07:00:05,907 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 07:00:05,907 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-04 07:00:05,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402805907"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:05,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402805907"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:05,913 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 07:00:05,913 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 70bdf6558089e4f79688284f6987a526, NAME => 'testtb-testExportFileSystemState,,1696402790303.70bdf6558089e4f79688284f6987a526.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3887cdbafec7b0dabebffed4f6f2d243, NAME => 'testtb-testExportFileSystemState,1,1696402790303.3887cdbafec7b0dabebffed4f6f2d243.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 07:00:05,913 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-04 07:00:05,913 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696402805913"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:05,915 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-04 07:00:05,917 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 07:00:05,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 53 msec 2023-10-04 07:00:05,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-04 07:00:05,975 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-04 07:00:05,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-04 07:00:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-04 07:00:05,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-10-04 07:00:05,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-04 07:00:06,020 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=768 (was 758) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2091322022_1 at /127.0.0.1:34606 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:45310 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:54686 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:39633 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:34630 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2079 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=364 (was 279) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=2593 (was 2771) 2023-10-04 07:00:06,021 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-10-04 07:00:06,044 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=169, AvailableMemoryMB=2592 2023-10-04 07:00:06,044 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-10-04 07:00:06,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 07:00:06,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-04 07:00:06,051 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 07:00:06,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-04 07:00:06,052 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 07:00:06,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 07:00:06,054 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,054 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,055 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714 empty. 2023-10-04 07:00:06,055 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86 empty. 2023-10-04 07:00:06,055 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,055 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,056 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-04 07:00:06,066 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-04 07:00:06,067 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6dc0625f162c10171858c0335618f714, NAME => 'testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:00:06,067 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7438160d7d9674780ccc8d978a1aee86, NAME => 'testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:00:06,092 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:06,092 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 7438160d7d9674780ccc8d978a1aee86, disabling compactions & flushes 2023-10-04 07:00:06,092 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,092 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,092 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. after waiting 0 ms 2023-10-04 07:00:06,092 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,092 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,092 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 7438160d7d9674780ccc8d978a1aee86: 2023-10-04 07:00:06,093 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:06,093 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 6dc0625f162c10171858c0335618f714, disabling compactions & flushes 2023-10-04 07:00:06,093 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,093 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,093 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. after waiting 0 ms 2023-10-04 07:00:06,093 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,093 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,093 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 6dc0625f162c10171858c0335618f714: 2023-10-04 07:00:06,096 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 07:00:06,097 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402806097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402806097"}]},"ts":"1696402806097"} 2023-10-04 07:00:06,097 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402806097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402806097"}]},"ts":"1696402806097"} 2023-10-04 07:00:06,100 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 07:00:06,103 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 07:00:06,103 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402806103"}]},"ts":"1696402806103"} 2023-10-04 07:00:06,105 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-04 07:00:06,107 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 07:00:06,108 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 07:00:06,108 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 07:00:06,108 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 07:00:06,109 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 07:00:06,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dc0625f162c10171858c0335618f714, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7438160d7d9674780ccc8d978a1aee86, ASSIGN}] 2023-10-04 07:00:06,112 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dc0625f162c10171858c0335618f714, ASSIGN 2023-10-04 07:00:06,112 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7438160d7d9674780ccc8d978a1aee86, ASSIGN 2023-10-04 07:00:06,113 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dc0625f162c10171858c0335618f714, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32841,1696402767186; forceNewPlan=false, retain=false 2023-10-04 07:00:06,113 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7438160d7d9674780ccc8d978a1aee86, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45271,1696402767235; forceNewPlan=false, retain=false 2023-10-04 07:00:06,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 07:00:06,263 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 07:00:06,265 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6dc0625f162c10171858c0335618f714, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,265 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7438160d7d9674780ccc8d978a1aee86, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,266 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402806265"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402806265"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402806265"}]},"ts":"1696402806265"} 2023-10-04 07:00:06,266 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402806265"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402806265"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402806265"}]},"ts":"1696402806265"} 2023-10-04 07:00:06,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 6dc0625f162c10171858c0335618f714, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:00:06,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 7438160d7d9674780ccc8d978a1aee86, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:00:06,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 07:00:06,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6dc0625f162c10171858c0335618f714, NAME => 'testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 07:00:06,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7438160d7d9674780ccc8d978a1aee86, NAME => 'testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. service=AccessControlService 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. service=AccessControlService 2023-10-04 07:00:06,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:06,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,426 INFO [StoreOpener-6dc0625f162c10171858c0335618f714-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,426 INFO [StoreOpener-7438160d7d9674780ccc8d978a1aee86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,427 DEBUG [StoreOpener-6dc0625f162c10171858c0335618f714-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf 2023-10-04 07:00:06,427 DEBUG [StoreOpener-6dc0625f162c10171858c0335618f714-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf 2023-10-04 07:00:06,427 DEBUG [StoreOpener-7438160d7d9674780ccc8d978a1aee86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf 2023-10-04 07:00:06,427 DEBUG [StoreOpener-7438160d7d9674780ccc8d978a1aee86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf 2023-10-04 07:00:06,428 INFO [StoreOpener-6dc0625f162c10171858c0335618f714-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dc0625f162c10171858c0335618f714 columnFamilyName cf 2023-10-04 07:00:06,428 INFO [StoreOpener-7438160d7d9674780ccc8d978a1aee86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7438160d7d9674780ccc8d978a1aee86 columnFamilyName cf 2023-10-04 07:00:06,429 INFO [StoreOpener-7438160d7d9674780ccc8d978a1aee86-1] regionserver.HStore(310): Store=7438160d7d9674780ccc8d978a1aee86/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:06,429 INFO [StoreOpener-6dc0625f162c10171858c0335618f714-1] regionserver.HStore(310): Store=6dc0625f162c10171858c0335618f714/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:06,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6dc0625f162c10171858c0335618f714 2023-10-04 07:00:06,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:06,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:00:06,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7438160d7d9674780ccc8d978a1aee86; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61800978, jitterRate=-0.07909366488456726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:06,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7438160d7d9674780ccc8d978a1aee86: 2023-10-04 07:00:06,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:00:06,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6dc0625f162c10171858c0335618f714; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65023544, jitterRate=-0.031073689460754395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:06,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86., pid=46, masterSystemTime=1696402806420 2023-10-04 07:00:06,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6dc0625f162c10171858c0335618f714: 2023-10-04 07:00:06,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714., pid=45, masterSystemTime=1696402806419 2023-10-04 07:00:06,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,446 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7438160d7d9674780ccc8d978a1aee86, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,446 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402806446"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402806446"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402806446"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402806446"}]},"ts":"1696402806446"} 2023-10-04 07:00:06,447 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6dc0625f162c10171858c0335618f714, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,447 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402806447"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402806447"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402806447"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402806447"}]},"ts":"1696402806447"} 2023-10-04 07:00:06,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-04 07:00:06,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 7438160d7d9674780ccc8d978a1aee86, server=jenkins-hbase20.apache.org,45271,1696402767235 in 180 msec 2023-10-04 07:00:06,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-04 07:00:06,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 6dc0625f162c10171858c0335618f714, server=jenkins-hbase20.apache.org,32841,1696402767186 in 182 msec 2023-10-04 07:00:06,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7438160d7d9674780ccc8d978a1aee86, ASSIGN in 341 msec 2023-10-04 07:00:06,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-04 07:00:06,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dc0625f162c10171858c0335618f714, ASSIGN in 342 msec 2023-10-04 07:00:06,455 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 07:00:06,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402806455"}]},"ts":"1696402806455"} 2023-10-04 07:00:06,457 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-04 07:00:06,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 07:00:06,459 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-04 07:00:06,461 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 07:00:06,462 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:06,463 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:06,463 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:06,462 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:06,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:06,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:06,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:06,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:06,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 418 msec 2023-10-04 07:00:06,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 07:00:06,656 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-04 07:00:06,658 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-04 07:00:06,658 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,660 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 07:00:06,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 07:00:06,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402806673 (current time:1696402806673). 2023-10-04 07:00:06,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:00:06,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x6d8529ac to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:06,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f14c7c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:06,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:06,685 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:06,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d8529ac to 127.0.0.1:49707 2023-10-04 07:00:06,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:06,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x1a25043b to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:06,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e29969a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:06,706 DEBUG [hconnection-0x673a4867-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:06,709 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:06,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a25043b to 127.0.0.1:49707 2023-10-04 07:00:06,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:06,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 07:00:06,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:00:06,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 07:00:06,719 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:00:06,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 07:00:06,722 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 07:00:06,723 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696403406723 2023-10-04 07:00:06,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 07:00:06,723 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-04 07:00:06,724 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:00:06,725 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:00:06,726 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 07:00:06,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 07:00:06,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-04 07:00:06,729 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 07:00:06,730 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696403406730 2023-10-04 07:00:06,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,752 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-04 07:00:06,752 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:06,754 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-04 07:00:06,754 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-04 07:00:06,754 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,754 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,755 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:06,755 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:06,755 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:06,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:06,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:06,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:06,755 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,756 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,757 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,757 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,757 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 07:00:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 07:00:06,758 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 07:00:06,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 07:00:06,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,758 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:06,758 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 07:00:06,758 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:06,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 07:00:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 07:00:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 07:00:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 07:00:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 07:00:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 07:00:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 07:00:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:06,764 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 07:00:06,764 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 07:00:06,764 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 07:00:06,771 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,771 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,771 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:06,771 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,771 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:06,772 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,772 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:06,772 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,772 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:06,772 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,772 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:06,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-04 07:00:06,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e395f29[Count = 1] remaining members to acquire global barrier 2023-10-04 07:00:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:06,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-04 07:00:06,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e395f29[Count = 0] remaining members to acquire global barrier 2023-10-04 07:00:06,776 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-04 07:00:06,776 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 07:00:06,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,781 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 07:00:06,780 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,781 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:00:06,781 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,781 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:06,781 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. started... 2023-10-04 07:00:06,781 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 07:00:06,781 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:06,781 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,781 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:06,783 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. started... 2023-10-04 07:00:06,783 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7438160d7d9674780ccc8d978a1aee86: 2023-10-04 07:00:06,783 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:06,781 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 07:00:06,783 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:00:06,783 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6dc0625f162c10171858c0335618f714: 2023-10-04 07:00:06,783 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,784 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:06,784 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,784 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 07:00:06,785 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:06,785 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 07:00:06,787 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 07:00:06,787 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:06,788 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 07:00:06,808 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. completed. 2023-10-04 07:00:06,808 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:06,808 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:06,808 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:06,808 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,808 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 07:00:06,809 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:00:06,810 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. completed. 2023-10-04 07:00:06,810 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:06,811 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:06,811 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:06,811 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,811 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 07:00:06,811 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:00:06,819 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 07:00:06,819 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:06,819 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,819 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 07:00:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:06,825 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:06,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 07:00:06,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 07:00:06,826 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 07:00:06,829 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 07:00:06,829 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:06,829 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,829 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 07:00:06,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,32841,1696402767186': 2023-10-04 07:00:06,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-04 07:00:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 07:00:06,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-04 07:00:06,838 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-04 07:00:06,838 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:00:06,838 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:00:06,838 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,838 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:00:06,839 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:06,839 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:06,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,839 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:06,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:06,839 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,840 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,841 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:06,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,842 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,842 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,843 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:06,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:06,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:06,845 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:06,846 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,846 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:06,846 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:06,847 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,847 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,845 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:06,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:06,846 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:06,845 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:06,847 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-04 07:00:06,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:06,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:06,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 07:00:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 07:00:06,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,890 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-04 07:00:06,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,891 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:06,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696402806723Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696402806866 (+143 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696402806866Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696402806866Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696402806872 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696402806883 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696402806890 (+7 ms) 2023-10-04 07:00:06,897 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 07:00:06,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 173 msec 2023-10-04 07:00:07,026 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:07,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 07:00:07,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:00:07,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32841] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 07:00:07,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45271] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 07:00:07,036 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-04 07:00:07,036 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:07,036 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 07:00:07,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 07:00:07,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402807049 (current time:1696402807049). 2023-10-04 07:00:07,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:00:07,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x50709893 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:07,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63440d71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:07,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:07,065 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:07,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50709893 to 127.0.0.1:49707 2023-10-04 07:00:07,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:07,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x3ba900db to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:07,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f49b33d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:07,090 DEBUG [hconnection-0x2c251420-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:07,091 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:07,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ba900db to 127.0.0.1:49707 2023-10-04 07:00:07,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:07,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 07:00:07,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:00:07,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 07:00:07,100 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:00:07,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 07:00:07,103 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 07:00:07,104 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696403407104 2023-10-04 07:00:07,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 07:00:07,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-04 07:00:07,105 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:00:07,106 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:00:07,107 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 07:00:07,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 07:00:07,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-04 07:00:07,110 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 07:00:07,111 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696403407111 2023-10-04 07:00:07,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-04 07:00:07,121 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-04 07:00:07,121 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:07,122 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-04 07:00:07,122 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-04 07:00:07,123 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,123 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,124 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:07,124 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:07,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:07,124 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,124 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:07,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:07,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,125 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,125 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,125 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,125 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 07:00:07,126 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 07:00:07,126 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 07:00:07,126 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 07:00:07,126 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:07,126 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 07:00:07,128 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:07,126 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:07,128 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 07:00:07,129 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 07:00:07,128 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 07:00:07,129 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 07:00:07,129 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 07:00:07,129 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 07:00:07,130 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 07:00:07,129 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 07:00:07,130 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 07:00:07,136 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,136 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:07,136 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,136 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,136 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,136 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:07,136 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:07,137 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,137 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,137 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:07,137 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:07,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-04 07:00:07,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c5f4952[Count = 1] remaining members to acquire global barrier 2023-10-04 07:00:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:07,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:07,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:07,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:07,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:07,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-04 07:00:07,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c5f4952[Count = 0] remaining members to acquire global barrier 2023-10-04 07:00:07,144 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-04 07:00:07,144 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 07:00:07,146 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 07:00:07,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,146 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,146 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:07,146 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:07,146 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:07,146 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:07,146 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 07:00:07,147 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. started... 2023-10-04 07:00:07,146 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. started... 2023-10-04 07:00:07,146 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:07,146 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:07,147 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6dc0625f162c10171858c0335618f714 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-04 07:00:07,146 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:00:07,147 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7438160d7d9674780ccc8d978a1aee86 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-04 07:00:07,147 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 07:00:07,147 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:00:07,148 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 07:00:07,148 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:07,148 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 07:00:07,175 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004e204fc32a37445548a123197187ccf69 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004e204fc32a37445548a123197187ccf69 2023-10-04 07:00:07,175 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310042d29f385bd09430da7d929985ce4e35a to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310042d29f385bd09430da7d929985ce4e35a 2023-10-04 07:00:07,195 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/.tmp/cf/c6310992b98f44929c86c97545babb81 2023-10-04 07:00:07,195 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/.tmp/cf/a58f85974a63444aa506106bae8885c3 2023-10-04 07:00:07,200 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/.tmp/cf/a58f85974a63444aa506106bae8885c3 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf/a58f85974a63444aa506106bae8885c3 2023-10-04 07:00:07,200 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/.tmp/cf/c6310992b98f44929c86c97545babb81 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf/c6310992b98f44929c86c97545babb81 2023-10-04 07:00:07,205 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf/a58f85974a63444aa506106bae8885c3, entries=5, sequenceid=6, filesize=5.7 K 2023-10-04 07:00:07,205 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf/c6310992b98f44929c86c97545babb81, entries=45, sequenceid=6, filesize=12.4 K 2023-10-04 07:00:07,206 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:07,206 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6dc0625f162c10171858c0335618f714 in 59ms, sequenceid=6, compaction requested=false 2023-10-04 07:00:07,206 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-04 07:00:07,206 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 7438160d7d9674780ccc8d978a1aee86 in 59ms, sequenceid=6, compaction requested=false 2023-10-04 07:00:07,206 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-04 07:00:07,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 07:00:07,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6dc0625f162c10171858c0335618f714: 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7438160d7d9674780ccc8d978a1aee86: 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 07:00:07,208 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf/c6310992b98f44929c86c97545babb81] hfiles 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf/a58f85974a63444aa506106bae8885c3] hfiles 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf/c6310992b98f44929c86c97545babb81 for snapshot=snaptb0-testConsecutiveExports 2023-10-04 07:00:07,208 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf/a58f85974a63444aa506106bae8885c3 for snapshot=snaptb0-testConsecutiveExports 2023-10-04 07:00:07,217 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. completed. 2023-10-04 07:00:07,217 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. completed. 2023-10-04 07:00:07,217 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:07,217 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 07:00:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:07,218 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:00:07,218 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,218 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 07:00:07,218 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:00:07,219 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,219 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 07:00:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:07,219 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 07:00:07,219 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:07,219 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,219 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:07,219 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 07:00:07,221 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 07:00:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:07,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,32841,1696402767186': 2023-10-04 07:00:07,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-04 07:00:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:07,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 07:00:07,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-04 07:00:07,230 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-04 07:00:07,230 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:00:07,230 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:00:07,230 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-04 07:00:07,230 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:00:07,231 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,231 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,231 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,231 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:07,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,231 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,232 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:07,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:07,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:07,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,232 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:07,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:07,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,232 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,233 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:07,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:07,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,234 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:07,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,236 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,237 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:07,237 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 07:00:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,247 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:07,247 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:07,247 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:07,247 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:07,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-04 07:00:07,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:07,248 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-04 07:00:07,247 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:07,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:07,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 07:00:07,247 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:07,247 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:07,247 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,247 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:07,249 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 07:00:07,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:07,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:07,249 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:07,250 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:07,250 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:07,250 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:07,250 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:07,250 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:07,250 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,250 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310042d29f385bd09430da7d929985ce4e35a, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004e204fc32a37445548a123197187ccf69] mob files 2023-10-04 07:00:07,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310042d29f385bd09430da7d929985ce4e35a 2023-10-04 07:00:07,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004e204fc32a37445548a123197187ccf69 2023-10-04 07:00:07,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-04 07:00:07,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-04 07:00:07,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,278 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696402807104Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696402807258 (+154 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696402807258Loading Region manifests for snaptb0-testConsecutiveExports at 1696402807258Writing data manifest for snaptb0-testConsecutiveExports at 1696402807262 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696402807269 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696402807277 (+8 ms) 2023-10-04 07:00:07,281 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 07:00:07,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 176 msec 2023-10-04 07:00:07,408 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:07,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 07:00:07,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:00:07,412 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412 2023-10-04 07:00:07,412 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412, srcFsUri=hdfs://localhost:34823, srcDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:00:07,437 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:00:07,437 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3208044e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,437 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840, snapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-04 07:00:07,444 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 07:00:07,454 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:07,454 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:07,454 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:07,455 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,165 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-2436387623143050813.jar 2023-10-04 07:00:08,165 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,165 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,219 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-5422876662637974414.jar 2023-10-04 07:00:08,219 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,219 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,220 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,220 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,220 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,221 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:08,221 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 07:00:08,221 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 07:00:08,221 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 07:00:08,222 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 07:00:08,222 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 07:00:08,223 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 07:00:08,223 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 07:00:08,223 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 07:00:08,223 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 07:00:08,224 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 07:00:08,224 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:08,224 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:08,225 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:08,225 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:08,225 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:08,226 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:08,226 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:08,606 WARN [Listener at jenkins-hbase20.apache.org/37865] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 07:00:08,609 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-04 07:00:08,610 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-04 07:00:09,720 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:00:09,720 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:00:09,722 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0002_000001 (auth:SIMPLE) 2023-10-04 07:00:10,655 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0003_000001 (auth:SIMPLE) 2023-10-04 07:00:11,328 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 07:00:14,138 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0003_000001 (auth:SIMPLE) 2023-10-04 07:00:16,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0003_000001 (auth:SIMPLE) 2023-10-04 07:00:18,325 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0003_000001 (auth:SIMPLE) 2023-10-04 07:00:19,800 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 07:00:19,800 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 07:00:19,803 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-04 07:00:19,803 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 07:00:19,804 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 07:00:19,804 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 07:00:19,807 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 07:00:19,807 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 07:00:19,807 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@e83937 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 07:00:19,807 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 07:00:19,807 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 07:00:19,808 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412, srcFsUri=hdfs://localhost:34823, srcDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:00:19,828 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:00:19,828 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4e8a9155, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 07:00:19,828 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840, snapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-04 07:00:19,838 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 07:00:19,848 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:19,849 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:19,849 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:19,850 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,556 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-4242910959781645673.jar 2023-10-04 07:00:20,556 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,556 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,611 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-1252645078847719769.jar 2023-10-04 07:00:20,611 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,612 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,612 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,613 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,613 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,614 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:20,614 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 07:00:20,615 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 07:00:20,615 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 07:00:20,615 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 07:00:20,615 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 07:00:20,616 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 07:00:20,616 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 07:00:20,616 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 07:00:20,617 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 07:00:20,617 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 07:00:20,618 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:20,618 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:20,619 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:20,619 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:20,619 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:20,619 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:20,620 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:20,990 WARN [Listener at jenkins-hbase20.apache.org/37865] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 07:00:20,992 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-04 07:00:20,994 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-04 07:00:24,519 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:00:24,519 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:00:24,522 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0003_000001 (auth:SIMPLE) 2023-10-04 07:00:24,738 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0004_000001 (auth:SIMPLE) 2023-10-04 07:00:28,115 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0004_000001 (auth:SIMPLE) 2023-10-04 07:00:30,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0004_000001 (auth:SIMPLE) 2023-10-04 07:00:32,819 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0004_000001 (auth:SIMPLE) 2023-10-04 07:00:34,176 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 07:00:34,176 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 07:00:34,181 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-04 07:00:34,181 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 07:00:34,181 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 07:00:34,181 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 07:00:34,182 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 07:00:34,182 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 07:00:34,182 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@e83937 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 07:00:34,182 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 07:00:34,182 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/local-export-1696402807412/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 07:00:34,194 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-04 07:00:34,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-10-04 07:00:34,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-04 07:00:34,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 07:00:34,199 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402834198"}]},"ts":"1696402834198"} 2023-10-04 07:00:34,200 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-04 07:00:34,201 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-04 07:00:34,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dc0625f162c10171858c0335618f714, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7438160d7d9674780ccc8d978a1aee86, UNASSIGN}] 2023-10-04 07:00:34,204 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dc0625f162c10171858c0335618f714, UNASSIGN 2023-10-04 07:00:34,204 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7438160d7d9674780ccc8d978a1aee86, UNASSIGN 2023-10-04 07:00:34,204 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6dc0625f162c10171858c0335618f714, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:34,205 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7438160d7d9674780ccc8d978a1aee86, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:34,205 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402834204"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402834204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402834204"}]},"ts":"1696402834204"} 2023-10-04 07:00:34,205 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402834204"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402834204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402834204"}]},"ts":"1696402834204"} 2023-10-04 07:00:34,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 6dc0625f162c10171858c0335618f714, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:00:34,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 7438160d7d9674780ccc8d978a1aee86, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:00:34,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 07:00:34,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6dc0625f162c10171858c0335618f714 2023-10-04 07:00:34,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:34,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6dc0625f162c10171858c0335618f714, disabling compactions & flushes 2023-10-04 07:00:34,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:34,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:34,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. after waiting 0 ms 2023-10-04 07:00:34,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:34,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7438160d7d9674780ccc8d978a1aee86, disabling compactions & flushes 2023-10-04 07:00:34,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:34,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:34,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. after waiting 0 ms 2023-10-04 07:00:34,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:34,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:00:34,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:00:34,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:34,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:34,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714. 2023-10-04 07:00:34,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86. 2023-10-04 07:00:34,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7438160d7d9674780ccc8d978a1aee86: 2023-10-04 07:00:34,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6dc0625f162c10171858c0335618f714: 2023-10-04 07:00:34,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6dc0625f162c10171858c0335618f714 2023-10-04 07:00:34,381 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6dc0625f162c10171858c0335618f714, regionState=CLOSED 2023-10-04 07:00:34,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:34,382 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402834381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402834381"}]},"ts":"1696402834381"} 2023-10-04 07:00:34,382 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7438160d7d9674780ccc8d978a1aee86, regionState=CLOSED 2023-10-04 07:00:34,382 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696402834382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402834382"}]},"ts":"1696402834382"} 2023-10-04 07:00:34,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-04 07:00:34,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 6dc0625f162c10171858c0335618f714, server=jenkins-hbase20.apache.org,32841,1696402767186 in 177 msec 2023-10-04 07:00:34,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-04 07:00:34,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 7438160d7d9674780ccc8d978a1aee86, server=jenkins-hbase20.apache.org,45271,1696402767235 in 177 msec 2023-10-04 07:00:34,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6dc0625f162c10171858c0335618f714, UNASSIGN in 183 msec 2023-10-04 07:00:34,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-04 07:00:34,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7438160d7d9674780ccc8d978a1aee86, UNASSIGN in 184 msec 2023-10-04 07:00:34,388 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402834388"}]},"ts":"1696402834388"} 2023-10-04 07:00:34,390 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-04 07:00:34,391 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-04 07:00:34,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 197 msec 2023-10-04 07:00:34,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 07:00:34,503 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-04 07:00:34,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-10-04 07:00:34,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 07:00:34,513 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 07:00:34,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-04 07:00:34,514 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 07:00:34,517 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-04 07:00:34,522 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 07:00:34,522 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 07:00:34,522 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 07:00:34,522 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 07:00:34,522 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 07:00:34,522 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 07:00:34,522 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 07:00:34,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 07:00:34,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 07:00:34,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 07:00:34,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 07:00:34,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:34,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 07:00:34,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:34,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:34,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:34,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-04 07:00:34,524 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714 2023-10-04 07:00:34,524 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:34,527 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/recovered.edits] 2023-10-04 07:00:34,527 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/recovered.edits] 2023-10-04 07:00:34,531 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf/c6310992b98f44929c86c97545babb81 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/cf/c6310992b98f44929c86c97545babb81 2023-10-04 07:00:34,532 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf/a58f85974a63444aa506106bae8885c3 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/cf/a58f85974a63444aa506106bae8885c3 2023-10-04 07:00:34,534 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86/recovered.edits/9.seqid 2023-10-04 07:00:34,534 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714/recovered.edits/9.seqid 2023-10-04 07:00:34,535 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/7438160d7d9674780ccc8d978a1aee86 2023-10-04 07:00:34,535 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testConsecutiveExports/6dc0625f162c10171858c0335618f714 2023-10-04 07:00:34,535 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-04 07:00:34,535 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-04 07:00:34,536 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-04 07:00:34,539 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310042d29f385bd09430da7d929985ce4e35a to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310042d29f385bd09430da7d929985ce4e35a 2023-10-04 07:00:34,540 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004e204fc32a37445548a123197187ccf69 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004e204fc32a37445548a123197187ccf69 2023-10-04 07:00:34,540 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-04 07:00:34,542 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 07:00:34,544 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-04 07:00:34,546 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-04 07:00:34,547 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 07:00:34,547 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-04 07:00:34,547 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402834547"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:34,547 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402834547"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:34,549 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 07:00:34,549 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6dc0625f162c10171858c0335618f714, NAME => 'testtb-testConsecutiveExports,,1696402806046.6dc0625f162c10171858c0335618f714.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7438160d7d9674780ccc8d978a1aee86, NAME => 'testtb-testConsecutiveExports,1,1696402806046.7438160d7d9674780ccc8d978a1aee86.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 07:00:34,549 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-04 07:00:34,549 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696402834549"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:34,551 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-04 07:00:34,552 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 07:00:34,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 46 msec 2023-10-04 07:00:34,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-04 07:00:34,627 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-04 07:00:34,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-04 07:00:34,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-04 07:00:34,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-10-04 07:00:34,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-04 07:00:34,679 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762 (was 768), OpenFileDescriptor=923 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 364), ProcessCount=167 (was 169), AvailableMemoryMB=2470 (was 2592) 2023-10-04 07:00:34,679 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-04 07:00:34,702 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=167, AvailableMemoryMB=2470 2023-10-04 07:00:34,702 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-04 07:00:34,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 07:00:34,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:34,709 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 07:00:34,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-04 07:00:34,710 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 07:00:34,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 07:00:34,712 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:34,712 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:34,713 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419 empty. 2023-10-04 07:00:34,713 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e empty. 2023-10-04 07:00:34,714 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:34,714 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:34,714 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-04 07:00:34,727 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-04 07:00:34,729 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 80f7318b5d8469ea80df16ca82d8495e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:00:34,729 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f1012c9333ea0f72169330f5897d1419, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:00:34,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:34,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 80f7318b5d8469ea80df16ca82d8495e, disabling compactions & flushes 2023-10-04 07:00:34,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:34,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:34,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f1012c9333ea0f72169330f5897d1419, disabling compactions & flushes 2023-10-04 07:00:34,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:34,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:34,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. after waiting 0 ms 2023-10-04 07:00:34,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:34,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. after waiting 0 ms 2023-10-04 07:00:34,743 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 80f7318b5d8469ea80df16ca82d8495e: 2023-10-04 07:00:34,743 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f1012c9333ea0f72169330f5897d1419: 2023-10-04 07:00:34,745 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 07:00:34,746 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402834746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402834746"}]},"ts":"1696402834746"} 2023-10-04 07:00:34,747 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402834746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402834746"}]},"ts":"1696402834746"} 2023-10-04 07:00:34,753 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 07:00:34,754 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 07:00:34,754 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402834754"}]},"ts":"1696402834754"} 2023-10-04 07:00:34,755 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-04 07:00:34,757 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 07:00:34,759 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 07:00:34,759 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 07:00:34,759 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 07:00:34,759 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 07:00:34,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1012c9333ea0f72169330f5897d1419, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80f7318b5d8469ea80df16ca82d8495e, ASSIGN}] 2023-10-04 07:00:34,762 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80f7318b5d8469ea80df16ca82d8495e, ASSIGN 2023-10-04 07:00:34,762 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1012c9333ea0f72169330f5897d1419, ASSIGN 2023-10-04 07:00:34,762 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80f7318b5d8469ea80df16ca82d8495e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44825,1696402767278; forceNewPlan=false, retain=false 2023-10-04 07:00:34,763 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1012c9333ea0f72169330f5897d1419, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45271,1696402767235; forceNewPlan=false, retain=false 2023-10-04 07:00:34,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 07:00:34,913 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 07:00:34,920 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f1012c9333ea0f72169330f5897d1419, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:34,920 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=80f7318b5d8469ea80df16ca82d8495e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:34,920 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402834920"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402834920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402834920"}]},"ts":"1696402834920"} 2023-10-04 07:00:34,921 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402834920"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402834920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402834920"}]},"ts":"1696402834920"} 2023-10-04 07:00:34,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure f1012c9333ea0f72169330f5897d1419, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:00:34,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 80f7318b5d8469ea80df16ca82d8495e, server=jenkins-hbase20.apache.org,44825,1696402767278}] 2023-10-04 07:00:35,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 07:00:35,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:35,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80f7318b5d8469ea80df16ca82d8495e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1012c9333ea0f72169330f5897d1419, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. service=AccessControlService 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. service=AccessControlService 2023-10-04 07:00:35,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:35,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:35,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:35,098 INFO [StoreOpener-f1012c9333ea0f72169330f5897d1419-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:35,098 INFO [StoreOpener-80f7318b5d8469ea80df16ca82d8495e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:35,099 DEBUG [StoreOpener-f1012c9333ea0f72169330f5897d1419-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf 2023-10-04 07:00:35,099 DEBUG [StoreOpener-80f7318b5d8469ea80df16ca82d8495e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf 2023-10-04 07:00:35,099 DEBUG [StoreOpener-f1012c9333ea0f72169330f5897d1419-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf 2023-10-04 07:00:35,099 DEBUG [StoreOpener-80f7318b5d8469ea80df16ca82d8495e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf 2023-10-04 07:00:35,100 INFO [StoreOpener-80f7318b5d8469ea80df16ca82d8495e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80f7318b5d8469ea80df16ca82d8495e columnFamilyName cf 2023-10-04 07:00:35,100 INFO [StoreOpener-f1012c9333ea0f72169330f5897d1419-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1012c9333ea0f72169330f5897d1419 columnFamilyName cf 2023-10-04 07:00:35,102 INFO [StoreOpener-80f7318b5d8469ea80df16ca82d8495e-1] regionserver.HStore(310): Store=80f7318b5d8469ea80df16ca82d8495e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:35,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:35,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:35,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:35,107 INFO [StoreOpener-f1012c9333ea0f72169330f5897d1419-1] regionserver.HStore(310): Store=f1012c9333ea0f72169330f5897d1419/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:35,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:35,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:00:35,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:35,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 80f7318b5d8469ea80df16ca82d8495e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74271442, jitterRate=0.10673072934150696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:35,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 80f7318b5d8469ea80df16ca82d8495e: 2023-10-04 07:00:35,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e., pid=61, masterSystemTime=1696402835077 2023-10-04 07:00:35,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:35,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:35,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:35,113 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=80f7318b5d8469ea80df16ca82d8495e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,113 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402835113"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402835113"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402835113"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402835113"}]},"ts":"1696402835113"} 2023-10-04 07:00:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:00:35,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f1012c9333ea0f72169330f5897d1419; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71928206, jitterRate=0.07181379199028015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f1012c9333ea0f72169330f5897d1419: 2023-10-04 07:00:35,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419., pid=60, masterSystemTime=1696402835076 2023-10-04 07:00:35,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,117 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f1012c9333ea0f72169330f5897d1419, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,118 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402835117"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402835117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402835117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402835117"}]},"ts":"1696402835117"} 2023-10-04 07:00:35,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-04 07:00:35,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 80f7318b5d8469ea80df16ca82d8495e, server=jenkins-hbase20.apache.org,44825,1696402767278 in 191 msec 2023-10-04 07:00:35,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80f7318b5d8469ea80df16ca82d8495e, ASSIGN in 359 msec 2023-10-04 07:00:35,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-04 07:00:35,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure f1012c9333ea0f72169330f5897d1419, server=jenkins-hbase20.apache.org,45271,1696402767235 in 195 msec 2023-10-04 07:00:35,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-04 07:00:35,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1012c9333ea0f72169330f5897d1419, ASSIGN in 362 msec 2023-10-04 07:00:35,123 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 07:00:35,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402835123"}]},"ts":"1696402835123"} 2023-10-04 07:00:35,124 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-04 07:00:35,126 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 07:00:35,126 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-04 07:00:35,128 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 07:00:35,129 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:35,129 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:35,129 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:35,129 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:35,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:35,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:35,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:35,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:35,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 425 msec 2023-10-04 07:00:35,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 07:00:35,317 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-04 07:00:35,321 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,321 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,325 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 07:00:35,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 07:00:35,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402835345 (current time:1696402835345). 2023-10-04 07:00:35,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:00:35,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x1de7daa5 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:35,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d077cda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:35,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:35,357 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:35,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1de7daa5 to 127.0.0.1:49707 2023-10-04 07:00:35,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:35,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x5bceaa9f to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:35,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@785f61b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:35,371 DEBUG [hconnection-0x3e7833cc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:35,375 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:35,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bceaa9f to 127.0.0.1:49707 2023-10-04 07:00:35,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:35,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 07:00:35,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:00:35,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 07:00:35,386 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:00:35,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 07:00:35,388 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 07:00:35,389 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696403435389 2023-10-04 07:00:35,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 07:00:35,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,391 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:00:35,391 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:00:35,392 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 07:00:35,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 07:00:35,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-04 07:00:35,395 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 07:00:35,396 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696403435396 2023-10-04 07:00:35,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,407 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-04 07:00:35,407 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-04 07:00:35,407 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:35,409 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-04 07:00:35,409 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-04 07:00:35,409 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,409 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,410 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,410 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,410 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,410 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,410 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,411 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,411 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,411 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 07:00:35,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 07:00:35,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 07:00:35,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,412 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 07:00:35,412 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 07:00:35,412 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:35,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,413 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 07:00:35,413 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 07:00:35,413 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:35,413 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 07:00:35,414 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 07:00:35,414 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 07:00:35,414 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:35,413 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 07:00:35,414 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 07:00:35,414 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 07:00:35,415 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 07:00:35,415 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 07:00:35,414 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,416 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:35,416 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:35,416 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 07:00:35,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@303098c4[Count = 1] remaining members to acquire global barrier 2023-10-04 07:00:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 07:00:35,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@303098c4[Count = 0] remaining members to acquire global barrier 2023-10-04 07:00:35,420 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-04 07:00:35,420 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,420 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,420 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,420 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,421 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,421 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 07:00:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,421 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 07:00:35,421 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 07:00:35,421 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,421 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:00:35,421 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:35,421 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:35,421 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. started... 2023-10-04 07:00:35,421 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 07:00:35,421 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:35,421 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80f7318b5d8469ea80df16ca82d8495e: 2023-10-04 07:00:35,421 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:35,423 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. started... 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,421 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1012c9333ea0f72169330f5897d1419: 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:35,423 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 07:00:35,425 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 07:00:35,425 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:35,425 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 07:00:35,441 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. completed. 2023-10-04 07:00:35,441 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. completed. 2023-10-04 07:00:35,441 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,441 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 07:00:35,441 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:00:35,442 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:00:35,443 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,443 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 07:00:35,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,443 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:35,443 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 07:00:35,443 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 07:00:35,443 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,445 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:35,445 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 07:00:35,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 07:00:35,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-04 07:00:35,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,44825,1696402767278': 2023-10-04 07:00:35,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-04 07:00:35,457 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-04 07:00:35,457 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:00:35,457 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:00:35,457 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,457 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:00:35,470 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,470 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,470 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,471 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,471 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,472 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,473 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,473 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,473 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,478 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:35,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,478 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,480 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,480 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,480 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,480 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 07:00:35,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,480 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,480 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,481 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 07:00:35,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,491 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:35,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 07:00:35,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-04 07:00:35,492 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 07:00:35,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-04 07:00:35,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,509 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696402835389Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696402835489 (+100 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696402835489Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696402835489Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696402835493 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696402835503 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696402835509 (+6 ms) 2023-10-04 07:00:35,511 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 07:00:35,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 120 msec 2023-10-04 07:00:35,692 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:35,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 07:00:35,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:00:35,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45271] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 07:00:35,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44825] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 07:00:35,708 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,708 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,709 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 07:00:35,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 07:00:35,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402835719 (current time:1696402835719). 2023-10-04 07:00:35,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:00:35,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x2e5b9594 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:35,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@124ab167, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:35,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:35,727 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:35,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e5b9594 to 127.0.0.1:49707 2023-10-04 07:00:35,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:35,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x28566295 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:35,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a53a53e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:35,746 DEBUG [hconnection-0x1dd5f69a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:35,750 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:35,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28566295 to 127.0.0.1:49707 2023-10-04 07:00:35,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:35,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 07:00:35,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:00:35,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 07:00:35,762 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:00:35,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 07:00:35,765 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 07:00:35,766 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696403435766 2023-10-04 07:00:35,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 07:00:35,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,767 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:00:35,767 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:00:35,769 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 07:00:35,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 07:00:35,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-04 07:00:35,771 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 07:00:35,772 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696403435772 2023-10-04 07:00:35,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,782 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-04 07:00:35,782 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:35,783 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-04 07:00:35,783 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-04 07:00:35,784 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,784 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,785 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,785 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,785 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,785 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,785 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,786 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,786 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,786 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,787 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 07:00:35,787 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 07:00:35,788 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:35,787 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:35,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,790 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 07:00:35,790 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 07:00:35,790 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:35,789 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 07:00:35,790 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 07:00:35,791 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 07:00:35,791 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 07:00:35,790 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 07:00:35,790 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 07:00:35,791 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 07:00:35,791 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:35,795 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,795 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,795 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 07:00:35,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1920a620[Count = 1] remaining members to acquire global barrier 2023-10-04 07:00:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 07:00:35,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1920a620[Count = 0] remaining members to acquire global barrier 2023-10-04 07:00:35,800 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-04 07:00:35,800 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 07:00:35,803 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,803 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 07:00:35,803 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 07:00:35,804 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:00:35,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,804 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:35,804 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,804 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,804 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:00:35,804 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:35,804 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 07:00:35,804 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. started... 2023-10-04 07:00:35,804 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:35,804 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f1012c9333ea0f72169330f5897d1419 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-04 07:00:35,804 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:35,804 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:35,805 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. started... 2023-10-04 07:00:35,805 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 07:00:35,805 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 80f7318b5d8469ea80df16ca82d8495e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-04 07:00:35,805 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:35,805 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 07:00:35,831 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310049b11f19230a942ad85db95f24b31c053 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310049b11f19230a942ad85db95f24b31c053 2023-10-04 07:00:35,832 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231004da38bc78712e44dca29a9e0a852cf9a7 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231004da38bc78712e44dca29a9e0a852cf9a7 2023-10-04 07:00:35,849 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/.tmp/cf/0311f430c9754c8f91abd549a7214286 2023-10-04 07:00:35,849 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/.tmp/cf/b4c99dff95374bd2a1f9d6c91b8c7ae8 2023-10-04 07:00:35,855 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/.tmp/cf/0311f430c9754c8f91abd549a7214286 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf/0311f430c9754c8f91abd549a7214286 2023-10-04 07:00:35,855 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/.tmp/cf/b4c99dff95374bd2a1f9d6c91b8c7ae8 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf/b4c99dff95374bd2a1f9d6c91b8c7ae8 2023-10-04 07:00:35,861 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf/0311f430c9754c8f91abd549a7214286, entries=3, sequenceid=6, filesize=5.4 K 2023-10-04 07:00:35,861 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf/b4c99dff95374bd2a1f9d6c91b8c7ae8, entries=47, sequenceid=6, filesize=13.5 K 2023-10-04 07:00:35,862 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f1012c9333ea0f72169330f5897d1419 in 58ms, sequenceid=6, compaction requested=false 2023-10-04 07:00:35,862 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 80f7318b5d8469ea80df16ca82d8495e in 57ms, sequenceid=6, compaction requested=false 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1012c9333ea0f72169330f5897d1419: 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80f7318b5d8469ea80df16ca82d8495e: 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf/0311f430c9754c8f91abd549a7214286] hfiles 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf/b4c99dff95374bd2a1f9d6c91b8c7ae8] hfiles 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf/b4c99dff95374bd2a1f9d6c91b8c7ae8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,864 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf/0311f430c9754c8f91abd549a7214286 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,867 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:35,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 07:00:35,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-04 07:00:35,869 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 07:00:35,874 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. completed. 2023-10-04 07:00:35,874 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. completed. 2023-10-04 07:00:35,874 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:35,874 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:00:35,875 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:00:35,877 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 07:00:35,877 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 07:00:35,877 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:35,877 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 07:00:35,877 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,877 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,878 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,878 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 07:00:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,44825,1696402767278': 2023-10-04 07:00:35,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-04 07:00:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 07:00:35,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-04 07:00:35,885 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-04 07:00:35,885 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:00:35,885 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:00:35,885 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,885 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:00:35,887 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:35,887 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,887 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:35,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,888 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,888 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,890 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,890 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:35,891 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,893 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,893 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,894 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,894 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,893 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:35,894 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,894 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,894 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,894 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,894 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:35,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:35,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,894 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:35,894 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,896 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:35,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 07:00:35,896 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:35,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:35,897 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:35,897 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:35,897 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,897 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231004da38bc78712e44dca29a9e0a852cf9a7, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310049b11f19230a942ad85db95f24b31c053] mob files 2023-10-04 07:00:35,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231004da38bc78712e44dca29a9e0a852cf9a7 2023-10-04 07:00:35,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310049b11f19230a942ad85db95f24b31c053 2023-10-04 07:00:35,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,920 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-04 07:00:35,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,920 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:35,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696402835766Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696402835904 (+138 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696402835904Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696402835904Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696402835907 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696402835914 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696402835920 (+6 ms) 2023-10-04 07:00:35,922 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 07:00:35,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 155 msec 2023-10-04 07:00:36,069 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:36,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 07:00:36,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:00:36,103 DEBUG [Listener at jenkins-hbase20.apache.org/37865] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 07:00:36,133 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 07:00:36,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32841] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 07:00:36,138 DEBUG [Listener at jenkins-hbase20.apache.org/37865] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 07:00:36,140 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 07:00:36,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44825] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 07:00:36,141 DEBUG [Listener at jenkins-hbase20.apache.org/37865] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 07:00:36,144 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 07:00:36,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45271] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 07:00:36,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-04 07:00:36,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:36,150 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 07:00:36,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-04 07:00:36,151 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 07:00:36,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 07:00:36,153 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,153 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,153 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97 empty. 2023-10-04 07:00:36,153 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937 empty. 2023-10-04 07:00:36,154 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,154 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,154 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-04 07:00:36,162 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-04 07:00:36,163 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d023e06138dcde1c486779260b106e97, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:00:36,163 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 21f5176efeb469003fce5eac98795937, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 21f5176efeb469003fce5eac98795937, disabling compactions & flushes 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d023e06138dcde1c486779260b106e97, disabling compactions & flushes 2023-10-04 07:00:36,177 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,177 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. after waiting 0 ms 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. after waiting 0 ms 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,177 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,177 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 21f5176efeb469003fce5eac98795937: 2023-10-04 07:00:36,177 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d023e06138dcde1c486779260b106e97: 2023-10-04 07:00:36,179 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 07:00:36,180 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402836180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402836180"}]},"ts":"1696402836180"} 2023-10-04 07:00:36,180 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402836180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402836180"}]},"ts":"1696402836180"} 2023-10-04 07:00:36,182 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 07:00:36,182 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 07:00:36,183 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402836182"}]},"ts":"1696402836182"} 2023-10-04 07:00:36,184 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-04 07:00:36,186 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 07:00:36,187 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 07:00:36,187 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 07:00:36,187 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 07:00:36,187 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 07:00:36,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d023e06138dcde1c486779260b106e97, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21f5176efeb469003fce5eac98795937, ASSIGN}] 2023-10-04 07:00:36,190 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21f5176efeb469003fce5eac98795937, ASSIGN 2023-10-04 07:00:36,190 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d023e06138dcde1c486779260b106e97, ASSIGN 2023-10-04 07:00:36,191 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21f5176efeb469003fce5eac98795937, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45271,1696402767235; forceNewPlan=false, retain=false 2023-10-04 07:00:36,191 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d023e06138dcde1c486779260b106e97, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32841,1696402767186; forceNewPlan=false, retain=false 2023-10-04 07:00:36,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 07:00:36,341 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 07:00:36,348 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=21f5176efeb469003fce5eac98795937, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:36,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d023e06138dcde1c486779260b106e97, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:36,348 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402836347"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402836347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402836347"}]},"ts":"1696402836347"} 2023-10-04 07:00:36,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402836347"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402836347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402836347"}]},"ts":"1696402836347"} 2023-10-04 07:00:36,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 21f5176efeb469003fce5eac98795937, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:00:36,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure d023e06138dcde1c486779260b106e97, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:00:36,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 07:00:36,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21f5176efeb469003fce5eac98795937, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.', STARTKEY => '2', ENDKEY => ''} 2023-10-04 07:00:36,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d023e06138dcde1c486779260b106e97, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.', STARTKEY => '', ENDKEY => '2'} 2023-10-04 07:00:36,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. service=AccessControlService 2023-10-04 07:00:36,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. service=AccessControlService 2023-10-04 07:00:36,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:36,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,516 INFO [StoreOpener-21f5176efeb469003fce5eac98795937-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,516 INFO [StoreOpener-d023e06138dcde1c486779260b106e97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,518 DEBUG [StoreOpener-21f5176efeb469003fce5eac98795937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf 2023-10-04 07:00:36,518 DEBUG [StoreOpener-21f5176efeb469003fce5eac98795937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf 2023-10-04 07:00:36,518 DEBUG [StoreOpener-d023e06138dcde1c486779260b106e97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf 2023-10-04 07:00:36,518 DEBUG [StoreOpener-d023e06138dcde1c486779260b106e97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf 2023-10-04 07:00:36,519 INFO [StoreOpener-21f5176efeb469003fce5eac98795937-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f5176efeb469003fce5eac98795937 columnFamilyName cf 2023-10-04 07:00:36,519 INFO [StoreOpener-d023e06138dcde1c486779260b106e97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d023e06138dcde1c486779260b106e97 columnFamilyName cf 2023-10-04 07:00:36,519 INFO [StoreOpener-d023e06138dcde1c486779260b106e97-1] regionserver.HStore(310): Store=d023e06138dcde1c486779260b106e97/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:36,519 INFO [StoreOpener-21f5176efeb469003fce5eac98795937-1] regionserver.HStore(310): Store=21f5176efeb469003fce5eac98795937/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:36,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:00:36,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:00:36,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 21f5176efeb469003fce5eac98795937; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74805365, jitterRate=0.11468680202960968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:36,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 21f5176efeb469003fce5eac98795937: 2023-10-04 07:00:36,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d023e06138dcde1c486779260b106e97; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66998329, jitterRate=-0.0016470998525619507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:36,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d023e06138dcde1c486779260b106e97: 2023-10-04 07:00:36,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937., pid=69, masterSystemTime=1696402836505 2023-10-04 07:00:36,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97., pid=70, masterSystemTime=1696402836506 2023-10-04 07:00:36,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,527 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d023e06138dcde1c486779260b106e97, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:36,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,527 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402836527"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402836527"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402836527"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402836527"}]},"ts":"1696402836527"} 2023-10-04 07:00:36,528 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=21f5176efeb469003fce5eac98795937, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:36,528 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402836527"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402836527"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402836527"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402836527"}]},"ts":"1696402836527"} 2023-10-04 07:00:36,530 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-04 07:00:36,530 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure d023e06138dcde1c486779260b106e97, server=jenkins-hbase20.apache.org,32841,1696402767186 in 175 msec 2023-10-04 07:00:36,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-04 07:00:36,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 21f5176efeb469003fce5eac98795937, server=jenkins-hbase20.apache.org,45271,1696402767235 in 178 msec 2023-10-04 07:00:36,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d023e06138dcde1c486779260b106e97, ASSIGN in 343 msec 2023-10-04 07:00:36,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-04 07:00:36,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21f5176efeb469003fce5eac98795937, ASSIGN in 344 msec 2023-10-04 07:00:36,533 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 07:00:36,533 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402836533"}]},"ts":"1696402836533"} 2023-10-04 07:00:36,534 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-04 07:00:36,536 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 07:00:36,536 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-04 07:00:36,538 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-04 07:00:36,539 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:36,539 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:36,539 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:36,539 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:36,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:36,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:36,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:36,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:36,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:36,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:36,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:36,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:36,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 393 msec 2023-10-04 07:00:36,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 07:00:36,758 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-04 07:00:36,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions d023e06138dcde1c486779260b106e97, 21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d023e06138dcde1c486779260b106e97, 21f5176efeb469003fce5eac98795937], force=true 2023-10-04 07:00:36,801 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d023e06138dcde1c486779260b106e97, 21f5176efeb469003fce5eac98795937], force=true 2023-10-04 07:00:36,801 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d023e06138dcde1c486779260b106e97, 21f5176efeb469003fce5eac98795937], force=true 2023-10-04 07:00:36,801 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d023e06138dcde1c486779260b106e97, 21f5176efeb469003fce5eac98795937], force=true 2023-10-04 07:00:36,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 07:00:36,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d023e06138dcde1c486779260b106e97, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21f5176efeb469003fce5eac98795937, UNASSIGN}] 2023-10-04 07:00:36,826 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21f5176efeb469003fce5eac98795937, UNASSIGN 2023-10-04 07:00:36,826 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d023e06138dcde1c486779260b106e97, UNASSIGN 2023-10-04 07:00:36,827 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=21f5176efeb469003fce5eac98795937, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:36,827 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d023e06138dcde1c486779260b106e97, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:36,827 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402836827"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402836827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402836827"}]},"ts":"1696402836827"} 2023-10-04 07:00:36,828 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402836827"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402836827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402836827"}]},"ts":"1696402836827"} 2023-10-04 07:00:36,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 21f5176efeb469003fce5eac98795937, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:00:36,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure d023e06138dcde1c486779260b106e97, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:00:36,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 07:00:36,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 21f5176efeb469003fce5eac98795937 2023-10-04 07:00:36,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 21f5176efeb469003fce5eac98795937, disabling compactions & flushes 2023-10-04 07:00:36,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. after waiting 0 ms 2023-10-04 07:00:36,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:36,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 21f5176efeb469003fce5eac98795937 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-04 07:00:36,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d023e06138dcde1c486779260b106e97 2023-10-04 07:00:36,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d023e06138dcde1c486779260b106e97, disabling compactions & flushes 2023-10-04 07:00:36,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. after waiting 0 ms 2023-10-04 07:00:36,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:36,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing d023e06138dcde1c486779260b106e97 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-04 07:00:37,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/.tmp/cf/5c608bee779e4d968bac0e9ec94ae929 2023-10-04 07:00:37,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/.tmp/cf/05062dec1dae41809a5786d00d6e6cf7 2023-10-04 07:00:37,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/.tmp/cf/5c608bee779e4d968bac0e9ec94ae929 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf/5c608bee779e4d968bac0e9ec94ae929 2023-10-04 07:00:37,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/.tmp/cf/05062dec1dae41809a5786d00d6e6cf7 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf/05062dec1dae41809a5786d00d6e6cf7 2023-10-04 07:00:37,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf/5c608bee779e4d968bac0e9ec94ae929, entries=1, sequenceid=5, filesize=4.7 K 2023-10-04 07:00:37,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf/05062dec1dae41809a5786d00d6e6cf7, entries=1, sequenceid=5, filesize=4.7 K 2023-10-04 07:00:37,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 21f5176efeb469003fce5eac98795937 in 33ms, sequenceid=5, compaction requested=false 2023-10-04 07:00:37,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 07:00:37,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d023e06138dcde1c486779260b106e97 in 30ms, sequenceid=5, compaction requested=false 2023-10-04 07:00:37,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 07:00:37,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-04 07:00:37,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-04 07:00:37,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:37,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937. 2023-10-04 07:00:37,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 21f5176efeb469003fce5eac98795937: 2023-10-04 07:00:37,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:37,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97. 2023-10-04 07:00:37,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d023e06138dcde1c486779260b106e97: 2023-10-04 07:00:37,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 21f5176efeb469003fce5eac98795937 2023-10-04 07:00:37,029 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=21f5176efeb469003fce5eac98795937, regionState=CLOSED 2023-10-04 07:00:37,029 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402837029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402837029"}]},"ts":"1696402837029"} 2023-10-04 07:00:37,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d023e06138dcde1c486779260b106e97 2023-10-04 07:00:37,030 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d023e06138dcde1c486779260b106e97, regionState=CLOSED 2023-10-04 07:00:37,030 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696402837030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402837030"}]},"ts":"1696402837030"} 2023-10-04 07:00:37,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-04 07:00:37,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 21f5176efeb469003fce5eac98795937, server=jenkins-hbase20.apache.org,45271,1696402767235 in 201 msec 2023-10-04 07:00:37,033 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-04 07:00:37,033 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure d023e06138dcde1c486779260b106e97, server=jenkins-hbase20.apache.org,32841,1696402767186 in 201 msec 2023-10-04 07:00:37,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21f5176efeb469003fce5eac98795937, UNASSIGN in 208 msec 2023-10-04 07:00:37,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-04 07:00:37,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d023e06138dcde1c486779260b106e97, UNASSIGN in 212 msec 2023-10-04 07:00:37,078 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-04 07:00:37,080 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836147.d023e06138dcde1c486779260b106e97.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:37,081 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696402836147.21f5176efeb469003fce5eac98795937.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:37,081 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:37,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 07:00:37,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=144bd524c457cea40484b279ff884c91, ASSIGN}] 2023-10-04 07:00:37,129 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=144bd524c457cea40484b279ff884c91, ASSIGN 2023-10-04 07:00:37,130 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=144bd524c457cea40484b279ff884c91, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,32841,1696402767186; forceNewPlan=false, retain=false 2023-10-04 07:00:37,280 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 07:00:37,284 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=144bd524c457cea40484b279ff884c91, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:37,284 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696402837284"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402837284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402837284"}]},"ts":"1696402837284"} 2023-10-04 07:00:37,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 144bd524c457cea40484b279ff884c91, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:00:37,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 07:00:37,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:37,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 144bd524c457cea40484b279ff884c91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.', STARTKEY => '', ENDKEY => ''} 2023-10-04 07:00:37,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. service=AccessControlService 2023-10-04 07:00:37,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 144bd524c457cea40484b279ff884c91 2023-10-04 07:00:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 144bd524c457cea40484b279ff884c91 2023-10-04 07:00:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 144bd524c457cea40484b279ff884c91 2023-10-04 07:00:37,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/.regioninfo 2023-10-04 07:00:37,470 INFO [StoreOpener-144bd524c457cea40484b279ff884c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 144bd524c457cea40484b279ff884c91 2023-10-04 07:00:37,472 DEBUG [StoreOpener-144bd524c457cea40484b279ff884c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf 2023-10-04 07:00:37,472 DEBUG [StoreOpener-144bd524c457cea40484b279ff884c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf 2023-10-04 07:00:37,472 INFO [StoreOpener-144bd524c457cea40484b279ff884c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 144bd524c457cea40484b279ff884c91 columnFamilyName cf 2023-10-04 07:00:37,500 DEBUG [StoreOpener-144bd524c457cea40484b279ff884c91-1] regionserver.HStore(539): loaded hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/05062dec1dae41809a5786d00d6e6cf7.d023e06138dcde1c486779260b106e97->hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf/05062dec1dae41809a5786d00d6e6cf7-top 2023-10-04 07:00:37,505 DEBUG [StoreOpener-144bd524c457cea40484b279ff884c91-1] regionserver.HStore(539): loaded hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/5c608bee779e4d968bac0e9ec94ae929.21f5176efeb469003fce5eac98795937->hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf/5c608bee779e4d968bac0e9ec94ae929-top 2023-10-04 07:00:37,505 INFO [StoreOpener-144bd524c457cea40484b279ff884c91-1] regionserver.HStore(310): Store=144bd524c457cea40484b279ff884c91/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:37,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91 2023-10-04 07:00:37,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91 2023-10-04 07:00:37,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 144bd524c457cea40484b279ff884c91 2023-10-04 07:00:37,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 144bd524c457cea40484b279ff884c91; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71608699, jitterRate=0.06705276668071747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:37,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 144bd524c457cea40484b279ff884c91: 2023-10-04 07:00:37,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91., pid=77, masterSystemTime=1696402837443 2023-10-04 07:00:37,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.,because compaction is disabled. 2023-10-04 07:00:37,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:37,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:37,516 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=144bd524c457cea40484b279ff884c91, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:37,516 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696402837516"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402837516"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402837516"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402837516"}]},"ts":"1696402837516"} 2023-10-04 07:00:37,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-04 07:00:37,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 144bd524c457cea40484b279ff884c91, server=jenkins-hbase20.apache.org,32841,1696402767186 in 228 msec 2023-10-04 07:00:37,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-04 07:00:37,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=144bd524c457cea40484b279ff884c91, ASSIGN in 391 msec 2023-10-04 07:00:37,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d023e06138dcde1c486779260b106e97, 21f5176efeb469003fce5eac98795937], force=true in 725 msec 2023-10-04 07:00:37,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 07:00:37,911 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-04 07:00:37,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 07:00:37,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402837912 (current time:1696402837912). 2023-10-04 07:00:37,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:00:37,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x2eac3a52 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:37,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bbd82f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:37,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:37,924 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:37,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eac3a52 to 127.0.0.1:49707 2023-10-04 07:00:37,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:37,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x0a47b436 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:37,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45767186, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:37,939 DEBUG [hconnection-0x1f56b3a7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:37,942 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:37,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a47b436 to 127.0.0.1:49707 2023-10-04 07:00:37,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:37,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-04 07:00:37,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:00:37,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 07:00:37,954 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:00:37,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 07:00:37,957 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 07:00:37,957 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696403437957 2023-10-04 07:00:37,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 07:00:37,961 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:00:37,962 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:00:37,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 07:00:37,963 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 07:00:37,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-10-04 07:00:37,965 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 07:00:37,966 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696403437966 2023-10-04 07:00:37,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,975 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 07:00:37,976 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:37,977 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-04 07:00:37,977 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-04 07:00:37,978 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,978 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,979 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:37,979 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:37,979 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:37,979 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:37,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:37,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:37,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:37,979 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:37,979 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:00:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 07:00:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 07:00:37,981 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 07:00:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 07:00:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,981 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 07:00:37,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,981 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 07:00:37,981 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 07:00:37,981 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:37,981 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:37,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 07:00:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 07:00:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 07:00:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 07:00:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 07:00:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 07:00:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 07:00:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:37,985 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 07:00:37,985 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 07:00:37,985 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 07:00:37,993 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,995 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:37,995 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:37,995 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,995 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:37,995 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:37,995 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,995 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:37,995 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,995 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:37,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-04 07:00:37,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d84723a[Count = 0] remaining members to acquire global barrier 2023-10-04 07:00:37,997 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-04 07:00:37,997 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,001 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,001 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,001 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,002 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,002 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:00:38,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 07:00:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 07:00:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 07:00:38,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:00:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 07:00:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:00:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 07:00:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:38,003 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:38,003 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:38,003 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. started... 2023-10-04 07:00:38,004 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 144bd524c457cea40484b279ff884c91: 2023-10-04 07:00:38,004 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 07:00:38,004 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:38,004 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,004 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 07:00:38,006 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:38,006 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 07:00:38,006 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:38,006 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 07:00:38,009 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/05062dec1dae41809a5786d00d6e6cf7.d023e06138dcde1c486779260b106e97->hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf/05062dec1dae41809a5786d00d6e6cf7-top, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/5c608bee779e4d968bac0e9ec94ae929.21f5176efeb469003fce5eac98795937->hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf/5c608bee779e4d968bac0e9ec94ae929-top] hfiles 2023-10-04 07:00:38,009 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/05062dec1dae41809a5786d00d6e6cf7.d023e06138dcde1c486779260b106e97 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,009 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/5c608bee779e4d968bac0e9ec94ae929.21f5176efeb469003fce5eac98795937 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,016 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. completed. 2023-10-04 07:00:38,016 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:38,016 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:38,016 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:38,016 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,016 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 07:00:38,016 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:00:38,019 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 07:00:38,019 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,019 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:38,020 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 07:00:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,32841,1696402767186': 2023-10-04 07:00:38,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-04 07:00:38,023 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-04 07:00:38,023 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:00:38,023 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:00:38,023 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,023 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:00:38,026 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,026 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,026 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,026 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:38,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,027 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:38,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,026 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:38,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,027 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:38,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,027 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:38,029 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,029 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:38,031 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:38,032 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,032 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,035 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:38,035 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:38,037 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:38,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:38,037 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:38,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:38,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:38,037 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:38,037 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:38,037 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:38,038 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,037 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:38,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:38,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:38,038 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:38,038 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:38,038 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,038 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:38,039 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,039 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:38,039 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:38,039 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,039 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,060 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-04 07:00:38,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,060 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696402837957Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696402838038 (+81 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696402838038Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696402838041 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696402838053 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696402838060 (+7 ms) 2023-10-04 07:00:38,062 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:38,063 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 07:00:38,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-04 07:00:38,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:00:38,064 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064 2023-10-04 07:00:38,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 102 msec 2023-10-04 07:00:38,064 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34823, tgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064, rawTgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064, srcFsUri=hdfs://localhost:34823, srcDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:00:38,081 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:00:38,081 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1575709479_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,082 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840, snapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-04 07:00:38,089 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:38,104 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,105 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,105 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,105 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,809 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-3706421209310089964.jar 2023-10-04 07:00:38,810 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,810 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,864 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-295535124739765344.jar 2023-10-04 07:00:38,864 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,865 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,865 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,865 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,866 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,866 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:38,866 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 07:00:38,867 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 07:00:38,867 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 07:00:38,867 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 07:00:38,867 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 07:00:38,868 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 07:00:38,868 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 07:00:38,868 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 07:00:38,869 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 07:00:38,869 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 07:00:38,870 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:38,870 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:38,871 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:38,871 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:38,871 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:38,871 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:38,872 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:39,003 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0004_000001 (auth:SIMPLE) 2023-10-04 07:00:39,238 WARN [Listener at jenkins-hbase20.apache.org/37865] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 07:00:39,240 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-04 07:00:39,244 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-04 07:00:39,301 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:00:39,301 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:00:39,828 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0005_000001 (auth:SIMPLE) 2023-10-04 07:00:39,955 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 07:00:43,238 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0005_000001 (auth:SIMPLE) 2023-10-04 07:00:45,444 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0005_000001 (auth:SIMPLE) 2023-10-04 07:00:47,450 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0005_000001 (auth:SIMPLE) 2023-10-04 07:00:49,453 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 07:00:49,456 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 07:00:49,465 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,465 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 07:00:49,466 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 07:00:49,466 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,466 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-04 07:00:49,466 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-04 07:00:49,466 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,467 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-04 07:00:49,467 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402838064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-04 07:00:49,473 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 07:00:49,477 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402849477"}]},"ts":"1696402849477"} 2023-10-04 07:00:49,478 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-04 07:00:49,479 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-04 07:00:49,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=144bd524c457cea40484b279ff884c91, UNASSIGN}] 2023-10-04 07:00:49,482 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=144bd524c457cea40484b279ff884c91, UNASSIGN 2023-10-04 07:00:49,483 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=144bd524c457cea40484b279ff884c91, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:49,483 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696402849483"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402849483"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402849483"}]},"ts":"1696402849483"} 2023-10-04 07:00:49,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 144bd524c457cea40484b279ff884c91, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:00:49,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 07:00:49,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 144bd524c457cea40484b279ff884c91 2023-10-04 07:00:49,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 144bd524c457cea40484b279ff884c91, disabling compactions & flushes 2023-10-04 07:00:49,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:49,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:49,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. after waiting 0 ms 2023-10-04 07:00:49,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:49,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-04 07:00:49,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:49,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91. 2023-10-04 07:00:49,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 144bd524c457cea40484b279ff884c91: 2023-10-04 07:00:49,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 144bd524c457cea40484b279ff884c91 2023-10-04 07:00:49,661 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=144bd524c457cea40484b279ff884c91, regionState=CLOSED 2023-10-04 07:00:49,661 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696402849661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402849661"}]},"ts":"1696402849661"} 2023-10-04 07:00:49,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-04 07:00:49,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 144bd524c457cea40484b279ff884c91, server=jenkins-hbase20.apache.org,32841,1696402767186 in 177 msec 2023-10-04 07:00:49,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-04 07:00:49,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=144bd524c457cea40484b279ff884c91, UNASSIGN in 183 msec 2023-10-04 07:00:49,665 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402849665"}]},"ts":"1696402849665"} 2023-10-04 07:00:49,666 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-04 07:00:49,667 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-04 07:00:49,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 195 msec 2023-10-04 07:00:49,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 07:00:49,780 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-04 07:00:49,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,788 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,789 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,790 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,792 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,792 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,792 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,793 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,793 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:49,794 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:49,793 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:49,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 07:00:49,794 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:49,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 07:00:49,794 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 07:00:49,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 07:00:49,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 07:00:49,794 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 07:00:49,794 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 07:00:49,794 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 07:00:49,795 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91 2023-10-04 07:00:49,795 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97 2023-10-04 07:00:49,795 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937 2023-10-04 07:00:49,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-04 07:00:49,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:49,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:49,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:49,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:49,797 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/recovered.edits] 2023-10-04 07:00:49,797 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/recovered.edits] 2023-10-04 07:00:49,798 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/recovered.edits] 2023-10-04 07:00:49,802 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf/5c608bee779e4d968bac0e9ec94ae929 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/cf/5c608bee779e4d968bac0e9ec94ae929 2023-10-04 07:00:49,802 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/05062dec1dae41809a5786d00d6e6cf7.d023e06138dcde1c486779260b106e97 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/05062dec1dae41809a5786d00d6e6cf7.d023e06138dcde1c486779260b106e97 2023-10-04 07:00:49,802 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf/05062dec1dae41809a5786d00d6e6cf7 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/cf/05062dec1dae41809a5786d00d6e6cf7 2023-10-04 07:00:49,803 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/5c608bee779e4d968bac0e9ec94ae929.21f5176efeb469003fce5eac98795937 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/cf/5c608bee779e4d968bac0e9ec94ae929.21f5176efeb469003fce5eac98795937 2023-10-04 07:00:49,805 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/recovered.edits/8.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937/recovered.edits/8.seqid 2023-10-04 07:00:49,805 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/recovered.edits/8.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97/recovered.edits/8.seqid 2023-10-04 07:00:49,805 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21f5176efeb469003fce5eac98795937 2023-10-04 07:00:49,805 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d023e06138dcde1c486779260b106e97 2023-10-04 07:00:49,806 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/recovered.edits/12.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91/recovered.edits/12.seqid 2023-10-04 07:00:49,806 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/144bd524c457cea40484b279ff884c91 2023-10-04 07:00:49,806 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-04 07:00:49,808 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,810 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-04 07:00:49,812 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-04 07:00:49,813 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,813 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-04 07:00:49,813 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402849813"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:49,815 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-04 07:00:49,815 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 144bd524c457cea40484b279ff884c91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696402836148.144bd524c457cea40484b279ff884c91.', STARTKEY => '', ENDKEY => ''}] 2023-10-04 07:00:49,815 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-04 07:00:49,815 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696402849815"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:49,817 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-04 07:00:49,819 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:49,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 37 msec 2023-10-04 07:00:49,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-04 07:00:49,897 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-04 07:00:49,898 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:49,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:49,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:49,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 07:00:49,905 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402849905"}]},"ts":"1696402849905"} 2023-10-04 07:00:49,908 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-04 07:00:49,910 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-04 07:00:49,911 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1012c9333ea0f72169330f5897d1419, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80f7318b5d8469ea80df16ca82d8495e, UNASSIGN}] 2023-10-04 07:00:49,913 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1012c9333ea0f72169330f5897d1419, UNASSIGN 2023-10-04 07:00:49,913 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80f7318b5d8469ea80df16ca82d8495e, UNASSIGN 2023-10-04 07:00:49,913 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f1012c9333ea0f72169330f5897d1419, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:49,913 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=80f7318b5d8469ea80df16ca82d8495e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:49,914 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402849913"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402849913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402849913"}]},"ts":"1696402849913"} 2023-10-04 07:00:49,914 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402849913"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402849913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402849913"}]},"ts":"1696402849913"} 2023-10-04 07:00:49,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure f1012c9333ea0f72169330f5897d1419, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:00:49,915 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 80f7318b5d8469ea80df16ca82d8495e, server=jenkins-hbase20.apache.org,44825,1696402767278}] 2023-10-04 07:00:50,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 07:00:50,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:50,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:50,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f1012c9333ea0f72169330f5897d1419, disabling compactions & flushes 2023-10-04 07:00:50,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:50,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:50,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. after waiting 0 ms 2023-10-04 07:00:50,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:50,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 80f7318b5d8469ea80df16ca82d8495e, disabling compactions & flushes 2023-10-04 07:00:50,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:50,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:50,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. after waiting 0 ms 2023-10-04 07:00:50,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:50,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:00:50,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:00:50,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:50,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:00:50,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419. 2023-10-04 07:00:50,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e. 2023-10-04 07:00:50,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f1012c9333ea0f72169330f5897d1419: 2023-10-04 07:00:50,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 80f7318b5d8469ea80df16ca82d8495e: 2023-10-04 07:00:50,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:50,092 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f1012c9333ea0f72169330f5897d1419, regionState=CLOSED 2023-10-04 07:00:50,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:50,093 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402850092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402850092"}]},"ts":"1696402850092"} 2023-10-04 07:00:50,093 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=80f7318b5d8469ea80df16ca82d8495e, regionState=CLOSED 2023-10-04 07:00:50,093 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696402850093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402850093"}]},"ts":"1696402850093"} 2023-10-04 07:00:50,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-04 07:00:50,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure f1012c9333ea0f72169330f5897d1419, server=jenkins-hbase20.apache.org,45271,1696402767235 in 179 msec 2023-10-04 07:00:50,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-04 07:00:50,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 80f7318b5d8469ea80df16ca82d8495e, server=jenkins-hbase20.apache.org,44825,1696402767278 in 180 msec 2023-10-04 07:00:50,097 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f1012c9333ea0f72169330f5897d1419, UNASSIGN in 185 msec 2023-10-04 07:00:50,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-04 07:00:50,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80f7318b5d8469ea80df16ca82d8495e, UNASSIGN in 185 msec 2023-10-04 07:00:50,098 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402850098"}]},"ts":"1696402850098"} 2023-10-04 07:00:50,099 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-04 07:00:50,100 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-04 07:00:50,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 203 msec 2023-10-04 07:00:50,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 07:00:50,210 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-04 07:00:50,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,219 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,221 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,223 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,223 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,223 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,223 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 07:00:50,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 07:00:50,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 07:00:50,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 07:00:50,225 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,225 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,225 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,225 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,225 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:50,225 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:50,225 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:50,225 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:50,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-04 07:00:50,226 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:50,226 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:50,228 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/recovered.edits] 2023-10-04 07:00:50,228 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/recovered.edits] 2023-10-04 07:00:50,233 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf/b4c99dff95374bd2a1f9d6c91b8c7ae8 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/cf/b4c99dff95374bd2a1f9d6c91b8c7ae8 2023-10-04 07:00:50,233 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf/0311f430c9754c8f91abd549a7214286 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/cf/0311f430c9754c8f91abd549a7214286 2023-10-04 07:00:50,236 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e/recovered.edits/9.seqid 2023-10-04 07:00:50,236 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419/recovered.edits/9.seqid 2023-10-04 07:00:50,236 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80f7318b5d8469ea80df16ca82d8495e 2023-10-04 07:00:50,236 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f1012c9333ea0f72169330f5897d1419 2023-10-04 07:00:50,236 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-04 07:00:50,237 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-04 07:00:50,237 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-04 07:00:50,240 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231004da38bc78712e44dca29a9e0a852cf9a7 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231004da38bc78712e44dca29a9e0a852cf9a7 2023-10-04 07:00:50,241 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310049b11f19230a942ad85db95f24b31c053 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310049b11f19230a942ad85db95f24b31c053 2023-10-04 07:00:50,241 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-04 07:00:50,243 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,245 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-04 07:00:50,246 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-04 07:00:50,247 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,248 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-04 07:00:50,248 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402850248"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:50,248 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402850248"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:50,249 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 07:00:50,249 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f1012c9333ea0f72169330f5897d1419, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696402834704.f1012c9333ea0f72169330f5897d1419.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 80f7318b5d8469ea80df16ca82d8495e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696402834704.80f7318b5d8469ea80df16ca82d8495e.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 07:00:50,249 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-04 07:00:50,249 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696402850249"}]},"ts":"9223372036854775807"} 2023-10-04 07:00:50,251 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-04 07:00:50,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 40 msec 2023-10-04 07:00:50,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-04 07:00:50,328 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-04 07:00:50,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-04 07:00:50,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-04 07:00:50,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 07:00:50,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-04 07:00:50,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 07:00:50,384 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=764 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1028090730_1 at /127.0.0.1:41006 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4069 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:41032 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:50048 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:60966 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:39977 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1028090730_1 at /127.0.0.1:60930 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 312), ProcessCount=167 (was 167), AvailableMemoryMB=2361 (was 2470) 2023-10-04 07:00:50,384 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-04 07:00:50,401 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=167, AvailableMemoryMB=2360 2023-10-04 07:00:50,401 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-04 07:00:50,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 07:00:50,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 07:00:50,406 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 07:00:50,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-04 07:00:50,407 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 07:00:50,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 07:00:50,409 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,409 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,410 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0 empty. 2023-10-04 07:00:50,410 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5 empty. 2023-10-04 07:00:50,410 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,410 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,410 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-04 07:00:50,422 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-04 07:00:50,424 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6eee60585780478a5bd30ecdde3d4fd0, NAME => 'testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:00:50,424 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 18d2d520fedfda7c6e1b49f7c63977f5, NAME => 'testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:00:50,444 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:50,444 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:50,444 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 18d2d520fedfda7c6e1b49f7c63977f5, disabling compactions & flushes 2023-10-04 07:00:50,444 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6eee60585780478a5bd30ecdde3d4fd0, disabling compactions & flushes 2023-10-04 07:00:50,445 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:50,445 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:50,445 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:50,445 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. after waiting 0 ms 2023-10-04 07:00:50,445 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:50,445 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:50,445 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. after waiting 0 ms 2023-10-04 07:00:50,445 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:50,445 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:50,445 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 18d2d520fedfda7c6e1b49f7c63977f5: 2023-10-04 07:00:50,445 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:50,445 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6eee60585780478a5bd30ecdde3d4fd0: 2023-10-04 07:00:50,447 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 07:00:50,448 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402850448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402850448"}]},"ts":"1696402850448"} 2023-10-04 07:00:50,448 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402850448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402850448"}]},"ts":"1696402850448"} 2023-10-04 07:00:50,450 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 07:00:50,451 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 07:00:50,451 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402850451"}]},"ts":"1696402850451"} 2023-10-04 07:00:50,452 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-04 07:00:50,454 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 07:00:50,455 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 07:00:50,455 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 07:00:50,455 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 07:00:50,455 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 07:00:50,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6eee60585780478a5bd30ecdde3d4fd0, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18d2d520fedfda7c6e1b49f7c63977f5, ASSIGN}] 2023-10-04 07:00:50,458 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18d2d520fedfda7c6e1b49f7c63977f5, ASSIGN 2023-10-04 07:00:50,458 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6eee60585780478a5bd30ecdde3d4fd0, ASSIGN 2023-10-04 07:00:50,459 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6eee60585780478a5bd30ecdde3d4fd0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32841,1696402767186; forceNewPlan=false, retain=false 2023-10-04 07:00:50,459 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18d2d520fedfda7c6e1b49f7c63977f5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45271,1696402767235; forceNewPlan=false, retain=false 2023-10-04 07:00:50,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 07:00:50,609 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 07:00:50,615 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6eee60585780478a5bd30ecdde3d4fd0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:50,615 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=18d2d520fedfda7c6e1b49f7c63977f5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:50,615 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402850615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402850615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402850615"}]},"ts":"1696402850615"} 2023-10-04 07:00:50,615 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402850615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402850615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402850615"}]},"ts":"1696402850615"} 2023-10-04 07:00:50,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 6eee60585780478a5bd30ecdde3d4fd0, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:00:50,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 18d2d520fedfda7c6e1b49f7c63977f5, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:00:50,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 07:00:50,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:50,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:50,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6eee60585780478a5bd30ecdde3d4fd0, NAME => 'testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 07:00:50,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18d2d520fedfda7c6e1b49f7c63977f5, NAME => 'testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 07:00:50,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. service=AccessControlService 2023-10-04 07:00:50,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. service=AccessControlService 2023-10-04 07:00:50,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:50,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:00:50,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:50,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:00:50,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,784 INFO [StoreOpener-6eee60585780478a5bd30ecdde3d4fd0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,784 INFO [StoreOpener-18d2d520fedfda7c6e1b49f7c63977f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,785 DEBUG [StoreOpener-18d2d520fedfda7c6e1b49f7c63977f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf 2023-10-04 07:00:50,785 DEBUG [StoreOpener-6eee60585780478a5bd30ecdde3d4fd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf 2023-10-04 07:00:50,785 DEBUG [StoreOpener-6eee60585780478a5bd30ecdde3d4fd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf 2023-10-04 07:00:50,785 DEBUG [StoreOpener-18d2d520fedfda7c6e1b49f7c63977f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf 2023-10-04 07:00:50,786 INFO [StoreOpener-6eee60585780478a5bd30ecdde3d4fd0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6eee60585780478a5bd30ecdde3d4fd0 columnFamilyName cf 2023-10-04 07:00:50,786 INFO [StoreOpener-18d2d520fedfda7c6e1b49f7c63977f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18d2d520fedfda7c6e1b49f7c63977f5 columnFamilyName cf 2023-10-04 07:00:50,787 INFO [StoreOpener-18d2d520fedfda7c6e1b49f7c63977f5-1] regionserver.HStore(310): Store=18d2d520fedfda7c6e1b49f7c63977f5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:50,787 INFO [StoreOpener-6eee60585780478a5bd30ecdde3d4fd0-1] regionserver.HStore(310): Store=6eee60585780478a5bd30ecdde3d4fd0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:00:50,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:00:50,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:00:50,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:00:50,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:00:50,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6eee60585780478a5bd30ecdde3d4fd0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68288712, jitterRate=0.01758110523223877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:50,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 18d2d520fedfda7c6e1b49f7c63977f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69217560, jitterRate=0.03142201900482178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:00:50,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6eee60585780478a5bd30ecdde3d4fd0: 2023-10-04 07:00:50,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 18d2d520fedfda7c6e1b49f7c63977f5: 2023-10-04 07:00:50,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0., pid=93, masterSystemTime=1696402850770 2023-10-04 07:00:50,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5., pid=94, masterSystemTime=1696402850772 2023-10-04 07:00:50,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:50,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:50,794 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6eee60585780478a5bd30ecdde3d4fd0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:50,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:50,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:50,795 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402850794"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402850794"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402850794"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402850794"}]},"ts":"1696402850794"} 2023-10-04 07:00:50,795 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=18d2d520fedfda7c6e1b49f7c63977f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:50,795 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402850795"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402850795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402850795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402850795"}]},"ts":"1696402850795"} 2023-10-04 07:00:50,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-04 07:00:50,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 6eee60585780478a5bd30ecdde3d4fd0, server=jenkins-hbase20.apache.org,32841,1696402767186 in 179 msec 2023-10-04 07:00:50,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-04 07:00:50,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 18d2d520fedfda7c6e1b49f7c63977f5, server=jenkins-hbase20.apache.org,45271,1696402767235 in 178 msec 2023-10-04 07:00:50,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6eee60585780478a5bd30ecdde3d4fd0, ASSIGN in 341 msec 2023-10-04 07:00:50,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-04 07:00:50,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18d2d520fedfda7c6e1b49f7c63977f5, ASSIGN in 342 msec 2023-10-04 07:00:50,800 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 07:00:50,800 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402850800"}]},"ts":"1696402850800"} 2023-10-04 07:00:50,801 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-04 07:00:50,802 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 07:00:50,803 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-04 07:00:50,804 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 07:00:50,805 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:50,805 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:50,805 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:50,805 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:00:50,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:50,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:50,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:50,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 07:00:50,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 403 msec 2023-10-04 07:00:51,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 07:00:51,015 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-04 07:00:51,021 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-04 07:00:51,021 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:51,024 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 07:00:51,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 07:00:51,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402851040 (current time:1696402851040). 2023-10-04 07:00:51,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:00:51,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x0ac77ceb to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:51,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14d67f5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:51,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:51,055 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:51,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ac77ceb to 127.0.0.1:49707 2023-10-04 07:00:51,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:51,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x04b1ddae to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:51,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3520d9f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:51,064 DEBUG [hconnection-0x12ab44af-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:51,065 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:51,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04b1ddae to 127.0.0.1:49707 2023-10-04 07:00:51,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:51,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 07:00:51,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:00:51,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 07:00:51,075 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:00:51,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 07:00:51,081 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 07:00:51,082 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696403451082 2023-10-04 07:00:51,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-04 07:00:51,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 07:00:51,084 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:00:51,084 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:00:51,085 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 07:00:51,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 07:00:51,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-04 07:00:51,089 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 07:00:51,090 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696403451090 2023-10-04 07:00:51,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,104 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-04 07:00:51,104 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:51,105 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-04 07:00:51,105 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-04 07:00:51,106 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,106 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,108 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,108 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,108 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,108 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,108 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,108 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,108 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,108 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:00:51,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,109 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 07:00:51,109 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 07:00:51,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,109 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:51,109 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:51,110 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 07:00:51,111 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 07:00:51,109 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 07:00:51,111 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:51,111 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 07:00:51,111 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 07:00:51,113 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 07:00:51,112 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 07:00:51,113 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 07:00:51,113 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 07:00:51,113 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 07:00:51,117 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,117 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,118 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,118 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,118 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,118 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,118 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,118 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,118 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:51,118 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,118 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 07:00:51,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ba7b101[Count = 1] remaining members to acquire global barrier 2023-10-04 07:00:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 07:00:51,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ba7b101[Count = 0] remaining members to acquire global barrier 2023-10-04 07:00:51,123 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 07:00:51,123 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 07:00:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,124 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:51,124 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:51,124 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:51,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. started... 2023-10-04 07:00:51,124 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 07:00:51,124 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,125 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:00:51,126 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18d2d520fedfda7c6e1b49f7c63977f5: 2023-10-04 07:00:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,124 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 07:00:51,126 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 07:00:51,126 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,126 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:00:51,126 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:51,126 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:51,126 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:51,126 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:51,126 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 07:00:51,126 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. started... 2023-10-04 07:00:51,127 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6eee60585780478a5bd30ecdde3d4fd0: 2023-10-04 07:00:51,127 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,127 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:51,127 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 07:00:51,127 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 07:00:51,127 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:51,127 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 07:00:51,138 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. completed. 2023-10-04 07:00:51,138 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:51,138 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:51,138 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:51,138 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,138 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 07:00:51,138 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:00:51,139 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. completed. 2023-10-04 07:00:51,139 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:51,139 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:51,139 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:51,139 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,139 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 07:00:51,139 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:00:51,144 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 07:00:51,144 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,144 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,144 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 07:00:51,146 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,146 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 07:00:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,146 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:51,146 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 07:00:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 07:00:51,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 07:00:51,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,32841,1696402767186': 2023-10-04 07:00:51,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 07:00:51,153 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-04 07:00:51,153 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:00:51,153 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:00:51,153 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,153 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:00:51,168 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,168 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,168 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,169 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,169 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,169 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,171 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,171 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,171 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,176 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-04 07:00:51,176 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,178 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 07:00:51,178 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,178 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,178 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,178 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,178 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,178 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 07:00:51,185 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:51,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 07:00:51,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 07:00:51,186 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 07:00:51,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-04 07:00:51,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,209 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696402851082Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696402851187 (+105 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696402851187Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696402851187Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696402851191 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696402851203 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696402851208 (+5 ms) 2023-10-04 07:00:51,213 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 07:00:51,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 130 msec 2023-10-04 07:00:51,386 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:51,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 07:00:51,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:00:51,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32841] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 07:00:51,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45271] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 07:00:51,398 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-04 07:00:51,398 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:51,399 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 07:00:51,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 07:00:51,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402851409 (current time:1696402851409). 2023-10-04 07:00:51,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:00:51,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x60d89a59 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:51,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24c5b68c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:51,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:51,419 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:51,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60d89a59 to 127.0.0.1:49707 2023-10-04 07:00:51,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:51,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x59bb9f66 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:00:51,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d15cc5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:00:51,431 DEBUG [hconnection-0x746d74a2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:00:51,434 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:00:51,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59bb9f66 to 127.0.0.1:49707 2023-10-04 07:00:51,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:00:51,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 07:00:51,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:00:51,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 07:00:51,445 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:00:51,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 07:00:51,448 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 07:00:51,449 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696403451449 2023-10-04 07:00:51,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 07:00:51,449 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-04 07:00:51,450 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:00:51,451 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:00:51,452 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 07:00:51,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 07:00:51,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-04 07:00:51,455 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 07:00:51,456 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696403451456 2023-10-04 07:00:51,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,466 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-04 07:00:51,466 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:51,467 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-04 07:00:51,467 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-04 07:00:51,468 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,468 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,469 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,469 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,469 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,469 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,469 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,469 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 07:00:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 07:00:51,470 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,471 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:00:51,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,471 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 07:00:51,471 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 07:00:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,473 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 07:00:51,473 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 07:00:51,473 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 07:00:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 07:00:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,473 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 07:00:51,473 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 07:00:51,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,474 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 07:00:51,474 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:51,474 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 07:00:51,475 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:00:51,475 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 07:00:51,475 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 07:00:51,475 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 07:00:51,479 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 07:00:51,479 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,479 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,479 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 07:00:51,479 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 07:00:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,480 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,480 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,484 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,485 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,485 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,485 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:51,485 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,486 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,486 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:00:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 07:00:51,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fe5f609[Count = 1] remaining members to acquire global barrier 2023-10-04 07:00:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 07:00:51,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fe5f609[Count = 0] remaining members to acquire global barrier 2023-10-04 07:00:51,491 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 07:00:51,491 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,494 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,494 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,494 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 07:00:51,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:00:51,495 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,495 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:00:51,495 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:00:51,495 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:51,495 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. started... 2023-10-04 07:00:51,496 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. started... 2023-10-04 07:00:51,496 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,496 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:00:51,496 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6eee60585780478a5bd30ecdde3d4fd0 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-04 07:00:51,496 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18d2d520fedfda7c6e1b49f7c63977f5 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-04 07:00:51,496 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 07:00:51,496 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:51,496 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 07:00:51,515 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004c7991e99639a4db08930adf90008face to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004c7991e99639a4db08930adf90008face 2023-10-04 07:00:51,515 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310047a5e7fec55794935be57899408ff72d9 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310047a5e7fec55794935be57899408ff72d9 2023-10-04 07:00:51,524 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/.tmp/cf/eeff8d6c8e9d4f3b8c65be1097376d64 2023-10-04 07:00:51,524 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/.tmp/cf/9b4e4b69aebd4858af35da5d398b3230 2023-10-04 07:00:51,530 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/.tmp/cf/eeff8d6c8e9d4f3b8c65be1097376d64 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf/eeff8d6c8e9d4f3b8c65be1097376d64 2023-10-04 07:00:51,531 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/.tmp/cf/9b4e4b69aebd4858af35da5d398b3230 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf/9b4e4b69aebd4858af35da5d398b3230 2023-10-04 07:00:51,535 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf/eeff8d6c8e9d4f3b8c65be1097376d64, entries=5, sequenceid=6, filesize=5.8 K 2023-10-04 07:00:51,536 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf/9b4e4b69aebd4858af35da5d398b3230, entries=45, sequenceid=6, filesize=12.7 K 2023-10-04 07:00:51,536 INFO [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6eee60585780478a5bd30ecdde3d4fd0 in 40ms, sequenceid=6, compaction requested=false 2023-10-04 07:00:51,536 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 18d2d520fedfda7c6e1b49f7c63977f5 in 40ms, sequenceid=6, compaction requested=false 2023-10-04 07:00:51,536 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-04 07:00:51,536 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-04 07:00:51,539 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6eee60585780478a5bd30ecdde3d4fd0: 2023-10-04 07:00:51,539 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18d2d520fedfda7c6e1b49f7c63977f5: 2023-10-04 07:00:51,539 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,539 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,540 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:51,540 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf/eeff8d6c8e9d4f3b8c65be1097376d64] hfiles 2023-10-04 07:00:51,540 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:00:51,540 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf/eeff8d6c8e9d4f3b8c65be1097376d64 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,540 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf/9b4e4b69aebd4858af35da5d398b3230] hfiles 2023-10-04 07:00:51,540 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf/9b4e4b69aebd4858af35da5d398b3230 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,551 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:51,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 07:00:51,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 07:00:51,552 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 07:00:51,554 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. completed. 2023-10-04 07:00:51,554 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:00:51,555 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:51,555 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:51,555 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,555 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 07:00:51,555 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:00:51,556 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 07:00:51,556 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,556 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:51,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,556 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 07:00:51,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,559 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. completed. 2023-10-04 07:00:51,559 DEBUG [rs(jenkins-hbase20.apache.org,32841,1696402767186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:00:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,559 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:00:51,559 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:00:51,559 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,559 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 07:00:51,559 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:00:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,568 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,568 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 07:00:51,568 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:51,568 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 07:00:51,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 07:00:51,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 07:00:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,32841,1696402767186': 2023-10-04 07:00:51,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 07:00:51,574 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-04 07:00:51,574 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:00:51,574 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:00:51,574 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,574 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:00:51,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:00:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:00:51,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:00:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,577 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,577 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,578 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:00:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,579 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,579 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,579 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,584 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,584 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,584 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,584 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,585 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,585 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:00:51,585 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,585 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,585 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,585 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:00:51,586 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-04 07:00:51,586 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:00:51,586 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:00:51,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:00:51,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,587 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:00:51,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 07:00:51,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:00:51,587 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:00:51,587 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:00:51,587 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:00:51,587 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,587 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310047a5e7fec55794935be57899408ff72d9, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004c7991e99639a4db08930adf90008face] mob files 2023-10-04 07:00:51,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310047a5e7fec55794935be57899408ff72d9 2023-10-04 07:00:51,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004c7991e99639a4db08930adf90008face 2023-10-04 07:00:51,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,610 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-04 07:00:51,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,610 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696402851449Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696402851593 (+144 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696402851593Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696402851593Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696402851596 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696402851602 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696402851610 (+8 ms) 2023-10-04 07:00:51,616 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 07:00:51,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 166 msec 2023-10-04 07:00:51,752 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:00:51,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 07:00:51,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:00:51,754 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754 2023-10-04 07:00:51,755 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34823, tgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754, rawTgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754, srcFsUri=hdfs://localhost:34823, srcDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:00:51,778 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:00:51,778 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-251969499_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,778 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840, snapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-04 07:00:51,783 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:00:51,800 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:51,800 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:51,801 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:51,802 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,511 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-7084086126147873287.jar 2023-10-04 07:00:52,511 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,511 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,565 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-7335542989994690421.jar 2023-10-04 07:00:52,565 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,565 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,566 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,566 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,566 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,567 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 07:00:52,567 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 07:00:52,567 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 07:00:52,567 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 07:00:52,568 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 07:00:52,568 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 07:00:52,568 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 07:00:52,569 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 07:00:52,569 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 07:00:52,569 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 07:00:52,570 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 07:00:52,570 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:52,570 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:52,571 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:52,571 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:52,571 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:00:52,571 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:52,572 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:00:52,926 WARN [Listener at jenkins-hbase20.apache.org/37865] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 07:00:52,928 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-04 07:00:53,641 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:00:53,641 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:00:53,647 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0005_000001 (auth:SIMPLE) 2023-10-04 07:00:54,018 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0006_000001 (auth:SIMPLE) 2023-10-04 07:00:55,238 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 07:00:57,339 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0006_000001 (auth:SIMPLE) 2023-10-04 07:01:00,318 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 07:01:00,319 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 07:01:00,325 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:01:00,325 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 07:01:00,325 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 07:01:00,325 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:01:00,326 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-04 07:01:00,326 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-04 07:01:00,326 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:01:00,327 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-04 07:01:00,327 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402851754/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-04 07:01:00,331 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 07:01:00,335 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402860335"}]},"ts":"1696402860335"} 2023-10-04 07:01:00,337 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-04 07:01:00,337 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-04 07:01:00,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6eee60585780478a5bd30ecdde3d4fd0, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18d2d520fedfda7c6e1b49f7c63977f5, UNASSIGN}] 2023-10-04 07:01:00,340 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6eee60585780478a5bd30ecdde3d4fd0, UNASSIGN 2023-10-04 07:01:00,340 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18d2d520fedfda7c6e1b49f7c63977f5, UNASSIGN 2023-10-04 07:01:00,341 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=18d2d520fedfda7c6e1b49f7c63977f5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:00,341 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6eee60585780478a5bd30ecdde3d4fd0, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:00,341 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402860341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402860341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402860341"}]},"ts":"1696402860341"} 2023-10-04 07:01:00,341 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402860341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402860341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402860341"}]},"ts":"1696402860341"} 2023-10-04 07:01:00,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 18d2d520fedfda7c6e1b49f7c63977f5, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:01:00,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 6eee60585780478a5bd30ecdde3d4fd0, server=jenkins-hbase20.apache.org,32841,1696402767186}] 2023-10-04 07:01:00,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 07:01:00,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:01:00,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:01:00,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 18d2d520fedfda7c6e1b49f7c63977f5, disabling compactions & flushes 2023-10-04 07:01:00,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:01:00,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:01:00,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. after waiting 0 ms 2023-10-04 07:01:00,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:01:00,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6eee60585780478a5bd30ecdde3d4fd0, disabling compactions & flushes 2023-10-04 07:01:00,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:01:00,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:01:00,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. after waiting 0 ms 2023-10-04 07:01:00,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:01:00,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:01:00,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:01:00,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:00,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:00,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5. 2023-10-04 07:01:00,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0. 2023-10-04 07:01:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 18d2d520fedfda7c6e1b49f7c63977f5: 2023-10-04 07:01:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6eee60585780478a5bd30ecdde3d4fd0: 2023-10-04 07:01:00,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:01:00,515 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=18d2d520fedfda7c6e1b49f7c63977f5, regionState=CLOSED 2023-10-04 07:01:00,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:01:00,515 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402860515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402860515"}]},"ts":"1696402860515"} 2023-10-04 07:01:00,515 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6eee60585780478a5bd30ecdde3d4fd0, regionState=CLOSED 2023-10-04 07:01:00,515 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696402860515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402860515"}]},"ts":"1696402860515"} 2023-10-04 07:01:00,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-10-04 07:01:00,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 18d2d520fedfda7c6e1b49f7c63977f5, server=jenkins-hbase20.apache.org,45271,1696402767235 in 174 msec 2023-10-04 07:01:00,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-10-04 07:01:00,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 6eee60585780478a5bd30ecdde3d4fd0, server=jenkins-hbase20.apache.org,32841,1696402767186 in 175 msec 2023-10-04 07:01:00,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=18d2d520fedfda7c6e1b49f7c63977f5, UNASSIGN in 180 msec 2023-10-04 07:01:00,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-10-04 07:01:00,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6eee60585780478a5bd30ecdde3d4fd0, UNASSIGN in 180 msec 2023-10-04 07:01:00,519 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402860519"}]},"ts":"1696402860519"} 2023-10-04 07:01:00,520 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-04 07:01:00,521 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-04 07:01:00,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 190 msec 2023-10-04 07:01:00,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 07:01:00,639 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-04 07:01:00,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,644 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,645 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,646 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,648 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,648 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,648 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,648 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 07:01:00,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 07:01:00,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 07:01:00,650 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,650 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,650 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 07:01:00,650 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:00,650 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:00,650 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,650 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:00,650 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:00,650 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:01:00,650 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:01:00,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-04 07:01:00,653 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/recovered.edits] 2023-10-04 07:01:00,653 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/recovered.edits] 2023-10-04 07:01:00,657 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf/9b4e4b69aebd4858af35da5d398b3230 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/cf/9b4e4b69aebd4858af35da5d398b3230 2023-10-04 07:01:00,657 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf/eeff8d6c8e9d4f3b8c65be1097376d64 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/cf/eeff8d6c8e9d4f3b8c65be1097376d64 2023-10-04 07:01:00,659 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5/recovered.edits/9.seqid 2023-10-04 07:01:00,659 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0/recovered.edits/9.seqid 2023-10-04 07:01:00,659 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/18d2d520fedfda7c6e1b49f7c63977f5 2023-10-04 07:01:00,659 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testEmptyExportFileSystemState/6eee60585780478a5bd30ecdde3d4fd0 2023-10-04 07:01:00,659 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-04 07:01:00,660 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-04 07:01:00,660 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-04 07:01:00,662 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310047a5e7fec55794935be57899408ff72d9 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310047a5e7fec55794935be57899408ff72d9 2023-10-04 07:01:00,663 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004c7991e99639a4db08930adf90008face to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004c7991e99639a4db08930adf90008face 2023-10-04 07:01:00,664 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-04 07:01:00,665 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,667 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-04 07:01:00,669 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-04 07:01:00,670 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,671 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-04 07:01:00,671 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402860671"}]},"ts":"9223372036854775807"} 2023-10-04 07:01:00,671 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402860671"}]},"ts":"9223372036854775807"} 2023-10-04 07:01:00,673 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 07:01:00,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6eee60585780478a5bd30ecdde3d4fd0, NAME => 'testtb-testEmptyExportFileSystemState,,1696402850402.6eee60585780478a5bd30ecdde3d4fd0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 18d2d520fedfda7c6e1b49f7c63977f5, NAME => 'testtb-testEmptyExportFileSystemState,1,1696402850402.18d2d520fedfda7c6e1b49f7c63977f5.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 07:01:00,673 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-04 07:01:00,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696402860673"}]},"ts":"9223372036854775807"} 2023-10-04 07:01:00,675 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-04 07:01:00,677 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 07:01:00,678 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-10-04 07:01:00,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-04 07:01:00,753 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-04 07:01:00,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-04 07:01:00,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 07:01:00,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-04 07:01:00,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-04 07:01:00,795 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 764) Potentially hanging thread: Thread-4722 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:35717 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:35663 from appattempt_1696402773467_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:47646 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:57878 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-717090868_1 at /127.0.0.1:47616 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:39969 from appattempt_1696402773467_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:47306 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=939 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 272) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=2247 (was 2360) 2023-10-04 07:01:00,795 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-04 07:01:00,812 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=167, AvailableMemoryMB=2246 2023-10-04 07:01:00,812 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-04 07:01:00,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 07:01:00,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:00,816 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 07:01:00,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-04 07:01:00,817 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 07:01:00,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 07:01:00,819 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:00,819 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:00,819 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c empty. 2023-10-04 07:01:00,819 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463 empty. 2023-10-04 07:01:00,820 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:00,820 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:00,820 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-04 07:01:00,828 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-04 07:01:00,829 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => d50127926b1466b5d08d6617419eb463, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:01:00,829 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d543ae88dba4d6b70b47de68c578de5c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp 2023-10-04 07:01:00,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:01:00,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d543ae88dba4d6b70b47de68c578de5c, disabling compactions & flushes 2023-10-04 07:01:00,844 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:00,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:00,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. after waiting 0 ms 2023-10-04 07:01:00,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:00,844 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:00,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d543ae88dba4d6b70b47de68c578de5c: 2023-10-04 07:01:00,845 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:01:00,845 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing d50127926b1466b5d08d6617419eb463, disabling compactions & flushes 2023-10-04 07:01:00,845 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:00,846 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:00,846 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. after waiting 0 ms 2023-10-04 07:01:00,846 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:00,846 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:00,846 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for d50127926b1466b5d08d6617419eb463: 2023-10-04 07:01:00,848 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 07:01:00,849 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402860849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402860849"}]},"ts":"1696402860849"} 2023-10-04 07:01:00,849 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402860849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402860849"}]},"ts":"1696402860849"} 2023-10-04 07:01:00,851 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 07:01:00,852 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 07:01:00,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402860852"}]},"ts":"1696402860852"} 2023-10-04 07:01:00,853 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-04 07:01:00,855 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 07:01:00,856 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 07:01:00,856 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 07:01:00,856 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 07:01:00,856 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 07:01:00,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d543ae88dba4d6b70b47de68c578de5c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d50127926b1466b5d08d6617419eb463, ASSIGN}] 2023-10-04 07:01:00,858 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d543ae88dba4d6b70b47de68c578de5c, ASSIGN 2023-10-04 07:01:00,858 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d50127926b1466b5d08d6617419eb463, ASSIGN 2023-10-04 07:01:00,859 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d543ae88dba4d6b70b47de68c578de5c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44825,1696402767278; forceNewPlan=false, retain=false 2023-10-04 07:01:00,859 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d50127926b1466b5d08d6617419eb463, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45271,1696402767235; forceNewPlan=false, retain=false 2023-10-04 07:01:00,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 07:01:01,009 INFO [jenkins-hbase20:44183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 07:01:01,012 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d543ae88dba4d6b70b47de68c578de5c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,012 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d50127926b1466b5d08d6617419eb463, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,013 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402861012"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402861012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402861012"}]},"ts":"1696402861012"} 2023-10-04 07:01:01,013 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402861012"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402861012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402861012"}]},"ts":"1696402861012"} 2023-10-04 07:01:01,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure d543ae88dba4d6b70b47de68c578de5c, server=jenkins-hbase20.apache.org,44825,1696402767278}] 2023-10-04 07:01:01,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure d50127926b1466b5d08d6617419eb463, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:01:01,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 07:01:01,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:01,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d543ae88dba4d6b70b47de68c578de5c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 07:01:01,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d50127926b1466b5d08d6617419eb463, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 07:01:01,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. service=AccessControlService 2023-10-04 07:01:01,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. service=AccessControlService 2023-10-04 07:01:01,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:01:01,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 07:01:01,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:01,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:01,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:01:01,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 07:01:01,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:01,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:01,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:01,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:01,176 INFO [StoreOpener-d543ae88dba4d6b70b47de68c578de5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:01,176 INFO [StoreOpener-d50127926b1466b5d08d6617419eb463-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:01,178 DEBUG [StoreOpener-d543ae88dba4d6b70b47de68c578de5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf 2023-10-04 07:01:01,178 DEBUG [StoreOpener-d543ae88dba4d6b70b47de68c578de5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf 2023-10-04 07:01:01,178 DEBUG [StoreOpener-d50127926b1466b5d08d6617419eb463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf 2023-10-04 07:01:01,178 DEBUG [StoreOpener-d50127926b1466b5d08d6617419eb463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf 2023-10-04 07:01:01,178 INFO [StoreOpener-d543ae88dba4d6b70b47de68c578de5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d543ae88dba4d6b70b47de68c578de5c columnFamilyName cf 2023-10-04 07:01:01,178 INFO [StoreOpener-d50127926b1466b5d08d6617419eb463-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d50127926b1466b5d08d6617419eb463 columnFamilyName cf 2023-10-04 07:01:01,179 INFO [StoreOpener-d543ae88dba4d6b70b47de68c578de5c-1] regionserver.HStore(310): Store=d543ae88dba4d6b70b47de68c578de5c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:01:01,179 INFO [StoreOpener-d50127926b1466b5d08d6617419eb463-1] regionserver.HStore(310): Store=d50127926b1466b5d08d6617419eb463/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 07:01:01,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:01,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:01,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:01,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:01,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:01:01,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 07:01:01,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d543ae88dba4d6b70b47de68c578de5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71883534, jitterRate=0.07114812731742859}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:01:01,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d50127926b1466b5d08d6617419eb463; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59980292, jitterRate=-0.10622400045394897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 07:01:01,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d543ae88dba4d6b70b47de68c578de5c: 2023-10-04 07:01:01,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d50127926b1466b5d08d6617419eb463: 2023-10-04 07:01:01,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463., pid=109, masterSystemTime=1696402861165 2023-10-04 07:01:01,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c., pid=108, masterSystemTime=1696402861165 2023-10-04 07:01:01,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:01,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:01,189 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d50127926b1466b5d08d6617419eb463, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,189 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402861188"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402861188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402861188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402861188"}]},"ts":"1696402861188"} 2023-10-04 07:01:01,189 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d543ae88dba4d6b70b47de68c578de5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,189 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402861189"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696402861189"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696402861189"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696402861189"}]},"ts":"1696402861189"} 2023-10-04 07:01:01,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-04 07:01:01,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure d50127926b1466b5d08d6617419eb463, server=jenkins-hbase20.apache.org,45271,1696402767235 in 175 msec 2023-10-04 07:01:01,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-04 07:01:01,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure d543ae88dba4d6b70b47de68c578de5c, server=jenkins-hbase20.apache.org,44825,1696402767278 in 176 msec 2023-10-04 07:01:01,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d50127926b1466b5d08d6617419eb463, ASSIGN in 335 msec 2023-10-04 07:01:01,193 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-04 07:01:01,193 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d543ae88dba4d6b70b47de68c578de5c, ASSIGN in 336 msec 2023-10-04 07:01:01,193 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 07:01:01,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402861193"}]},"ts":"1696402861193"} 2023-10-04 07:01:01,194 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-04 07:01:01,196 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 07:01:01,196 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-04 07:01:01,198 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 07:01:01,198 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:01,198 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:01,198 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:01,198 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:01,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 07:01:01,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 07:01:01,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 07:01:01,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 07:01:01,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 386 msec 2023-10-04 07:01:01,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 07:01:01,424 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-04 07:01:01,429 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,429 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,431 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 07:01:01,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 07:01:01,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402861449 (current time:1696402861449). 2023-10-04 07:01:01,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:01:01,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x37935b70 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:01:01,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72adbcb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:01:01,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:01:01,458 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:01:01,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37935b70 to 127.0.0.1:49707 2023-10-04 07:01:01,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:01,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x17793532 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:01:01,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a9cb476, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:01:01,472 DEBUG [hconnection-0x254bcfa0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:01:01,477 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:01:01,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17793532 to 127.0.0.1:49707 2023-10-04 07:01:01,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:01,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 07:01:01,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:01:01,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 07:01:01,487 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:01:01,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 07:01:01,490 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 07:01:01,490 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696403461490 2023-10-04 07:01:01,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 07:01:01,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,492 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:01:01,492 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:01:01,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 07:01:01,495 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 07:01:01,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-10-04 07:01:01,497 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 07:01:01,498 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696403461498 2023-10-04 07:01:01,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,507 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-04 07:01:01,507 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:01:01,508 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-04 07:01:01,508 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-04 07:01:01,508 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,508 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,511 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,511 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,511 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,511 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,512 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,512 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,512 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 07:01:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 07:01:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,514 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 07:01:01,514 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 07:01:01,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,514 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:01:01,514 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 07:01:01,514 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 07:01:01,515 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 07:01:01,514 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:01:01,514 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 07:01:01,515 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 07:01:01,515 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 07:01:01,515 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 07:01:01,515 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 07:01:01,515 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 07:01:01,519 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,519 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:01:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63e85e73[Count = 1] remaining members to acquire global barrier 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 07:01:01,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63e85e73[Count = 0] remaining members to acquire global barrier 2023-10-04 07:01:01,522 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-04 07:01:01,522 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 07:01:01,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:01:01,523 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,523 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:01:01,523 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,523 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:01:01,524 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. started... 2023-10-04 07:01:01,524 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. started... 2023-10-04 07:01:01,525 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d50127926b1466b5d08d6617419eb463: 2023-10-04 07:01:01,525 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d543ae88dba4d6b70b47de68c578de5c: 2023-10-04 07:01:01,525 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 07:01:01,525 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,525 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:01:01,525 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,525 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 07:01:01,525 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:01:01,526 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:01:01,526 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 07:01:01,526 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 07:01:01,535 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. completed. 2023-10-04 07:01:01,535 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,535 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. completed. 2023-10-04 07:01:01,535 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:01:01,535 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:01:01,535 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:01,535 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,535 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:01:01,535 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 07:01:01,536 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:01:01,536 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:01:01,536 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,536 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 07:01:01,536 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:01:01,537 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 07:01:01,537 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,537 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 07:01:01,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,537 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,537 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:01:01,537 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 07:01:01,537 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:01:01,538 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 07:01:01,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44825,1696402767278': 2023-10-04 07:01:01,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-04 07:01:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 07:01:01,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-04 07:01:01,546 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-04 07:01:01,546 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:01:01,546 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:01:01,546 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,546 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:01:01,561 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,562 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,563 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,563 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,563 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,565 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,565 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,565 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,567 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:01:01,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,569 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,567 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,567 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,569 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,569 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 07:01:01,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,569 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,570 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,570 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 07:01:01,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,592 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:01:01,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 07:01:01,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 07:01:01,593 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 07:01:01,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,601 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-04 07:01:01,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,601 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696402861491Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696402861579 (+88 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696402861579Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696402861579Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696402861584 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696402861596 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696402861601 (+5 ms) 2023-10-04 07:01:01,604 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 07:01:01,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 112 msec 2023-10-04 07:01:01,794 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:01:01,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 07:01:01,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:01:01,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44825] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 07:01:01,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45271] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 07:01:01,807 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,807 DEBUG [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,807 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 07:01:01,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 07:01:01,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696402861816 (current time:1696402861816). 2023-10-04 07:01:01,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 07:01:01,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x7d2726dd to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:01:01,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69b2ad1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:01:01,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:01:01,826 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:01:01,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d2726dd to 127.0.0.1:49707 2023-10-04 07:01:01,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:01,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(139): Connect 0x7d1fd396 to 127.0.0.1:49707 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 07:01:01,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@394a0326, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 07:01:01,846 DEBUG [hconnection-0x45ec935e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 07:01:01,847 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 07:01:01,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d1fd396 to 127.0.0.1:49707 2023-10-04 07:01:01,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:01,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 07:01:01,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 07:01:01,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 07:01:01,859 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot, current working dir path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 07:01:01,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 07:01:01,861 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 07:01:01,862 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696403461862 2023-10-04 07:01:01,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 07:01:01,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,863 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 07:01:01,863 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 07:01:01,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 07:01:01,865 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 07:01:01,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-04 07:01:01,867 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 07:01:01,867 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696403461867 2023-10-04 07:01:01,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,876 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-04 07:01:01,876 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:01:01,877 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-04 07:01:01,877 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-04 07:01:01,877 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,877 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,878 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,878 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,878 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,878 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,879 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,879 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,879 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,879 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 07:01:01,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 07:01:01,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 07:01:01,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 07:01:01,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,880 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 07:01:01,880 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 07:01:01,880 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:01:01,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,881 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 07:01:01,881 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 07:01:01,881 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:01:01,880 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 07:01:01,882 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 07:01:01,883 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 07:01:01,881 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 07:01:01,883 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 07:01:01,883 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 07:01:01,883 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 07:01:01,883 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 07:01:01,883 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32841,1696402767186' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 07:01:01,885 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,885 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,885 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,885 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,887 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,887 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,887 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:01:01,887 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,887 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:01:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,887 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,887 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 07:01:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45271,1696402767235' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 07:01:01,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3da3f596[Count = 1] remaining members to acquire global barrier 2023-10-04 07:01:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44825,1696402767278' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 07:01:01,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3da3f596[Count = 0] remaining members to acquire global barrier 2023-10-04 07:01:01,890 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-04 07:01:01,891 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,891 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 07:01:01,892 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 07:01:01,892 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 07:01:01,892 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,32841,1696402767186' in zk 2023-10-04 07:01:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,892 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:01:01,892 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:01:01,892 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:01,892 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 07:01:01,892 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. started... 2023-10-04 07:01:01,892 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,892 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 07:01:01,892 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,892 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 07:01:01,892 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 07:01:01,892 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d50127926b1466b5d08d6617419eb463 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-04 07:01:01,892 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. started... 2023-10-04 07:01:01,892 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d543ae88dba4d6b70b47de68c578de5c 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-04 07:01:01,893 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 07:01:01,893 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:01:01,893 DEBUG [member: 'jenkins-hbase20.apache.org,32841,1696402767186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 07:01:01,910 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100436422ef9335d43de9ee1ca46dbb3b279 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100436422ef9335d43de9ee1ca46dbb3b279 2023-10-04 07:01:01,911 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310045f500db4e1134ea3a16ea33d7fc2e341 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310045f500db4e1134ea3a16ea33d7fc2e341 2023-10-04 07:01:01,918 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/.tmp/cf/e56756f4a2604b5c82d2fac580c1deed 2023-10-04 07:01:01,918 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/.tmp/cf/db5b49d9cdde40b2828483057ee78d22 2023-10-04 07:01:01,923 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/.tmp/cf/db5b49d9cdde40b2828483057ee78d22 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf/db5b49d9cdde40b2828483057ee78d22 2023-10-04 07:01:01,923 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/.tmp/cf/e56756f4a2604b5c82d2fac580c1deed as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf/e56756f4a2604b5c82d2fac580c1deed 2023-10-04 07:01:01,927 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf/db5b49d9cdde40b2828483057ee78d22, entries=5, sequenceid=6, filesize=5.8 K 2023-10-04 07:01:01,927 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf/e56756f4a2604b5c82d2fac580c1deed, entries=45, sequenceid=6, filesize=13.0 K 2023-10-04 07:01:01,928 INFO [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d543ae88dba4d6b70b47de68c578de5c in 36ms, sequenceid=6, compaction requested=false 2023-10-04 07:01:01,928 INFO [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for d50127926b1466b5d08d6617419eb463 in 36ms, sequenceid=6, compaction requested=false 2023-10-04 07:01:01,928 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-04 07:01:01,928 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-04 07:01:01,930 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d543ae88dba4d6b70b47de68c578de5c: 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d50127926b1466b5d08d6617419eb463: 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf/db5b49d9cdde40b2828483057ee78d22] hfiles 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf/db5b49d9cdde40b2828483057ee78d22 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf/e56756f4a2604b5c82d2fac580c1deed] hfiles 2023-10-04 07:01:01,931 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf/e56756f4a2604b5c82d2fac580c1deed for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,943 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. completed. 2023-10-04 07:01:01,943 DEBUG [rs(jenkins-hbase20.apache.org,45271,1696402767235)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:01,943 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. completed. 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:01:01,943 DEBUG [rs(jenkins-hbase20.apache.org,44825,1696402767278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44825,1696402767278' in zk 2023-10-04 07:01:01,943 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,45271,1696402767235' in zk 2023-10-04 07:01:01,945 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,945 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 07:01:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,945 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,945 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 07:01:01,945 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:01:01,945 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:01:01,945 DEBUG [member: 'jenkins-hbase20.apache.org,45271,1696402767235' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 07:01:01,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,946 DEBUG [member: 'jenkins-hbase20.apache.org,44825,1696402767278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 07:01:01,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,45271,1696402767235': 2023-10-04 07:01:01,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45271,1696402767235' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-04 07:01:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44825,1696402767278': 2023-10-04 07:01:01,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44825,1696402767278' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-04 07:01:01,955 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-04 07:01:01,955 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 07:01:01,955 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 07:01:01,955 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,955 INFO [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 07:01:01,960 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,960 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,960 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,960 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 07:01:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 07:01:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 07:01:01,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,962 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,962 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 07:01:01,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,964 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:01:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,964 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 07:01:01,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 07:01:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 07:01:01,965 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,965 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 07:01:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,965 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,969 DEBUG [(jenkins-hbase20.apache.org,44183,1696402766121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:01,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,971 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 07:01:01,971 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,971 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,969 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,969 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,971 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:01,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 07:01:01,971 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 07:01:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 07:01:01,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 07:01:01,972 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:01,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,972 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 07:01:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 07:01:01,973 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310045f500db4e1134ea3a16ea33d7fc2e341, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100436422ef9335d43de9ee1ca46dbb3b279] mob files 2023-10-04 07:01:01,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310045f500db4e1134ea3a16ea33d7fc2e341 2023-10-04 07:01:01,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100436422ef9335d43de9ee1ca46dbb3b279 2023-10-04 07:01:01,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:01,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:02,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:02,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-04 07:01:02,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:02,010 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:02,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696402861862Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696402861983 (+121 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696402861983Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696402861983Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696402861989 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696402862000 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696402862009 (+9 ms) 2023-10-04 07:01:02,012 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 07:01:02,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 149 msec 2023-10-04 07:01:02,165 DEBUG [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 07:01:02,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 07:01:02,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 07:01:02,169 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169 2023-10-04 07:01:02,169 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34823, tgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169, rawTgtDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169, srcFsUri=hdfs://localhost:34823, srcDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:01:02,193 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840 2023-10-04 07:01:02,193 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1900462751_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:02,193 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34823, inputRoot=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840, snapshotDir=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-04 07:01:02,207 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:02,226 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,226 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,227 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,227 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,929 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-4563189727661433099.jar 2023-10-04 07:01:02,929 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,930 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,983 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/hadoop-852248351895810067.jar 2023-10-04 07:01:02,983 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,983 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,984 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,984 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,984 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,985 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 07:01:02,985 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 07:01:02,985 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 07:01:02,985 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 07:01:02,986 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 07:01:02,986 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 07:01:02,986 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 07:01:02,987 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 07:01:02,987 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 07:01:02,987 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 07:01:02,988 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 07:01:02,988 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:01:02,988 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:01:02,989 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:01:02,989 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:01:02,989 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 07:01:02,989 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:01:02,990 DEBUG [Listener at jenkins-hbase20.apache.org/37865] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 07:01:03,333 WARN [Listener at jenkins-hbase20.apache.org/37865] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 07:01:03,335 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-04 07:01:03,336 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-04 07:01:04,680 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:01:04,680 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 07:01:04,686 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0006_000001 (auth:SIMPLE) 2023-10-04 07:01:05,657 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0007_000001 (auth:SIMPLE) 2023-10-04 07:01:06,087 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 07:01:08,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0007_000001 (auth:SIMPLE) 2023-10-04 07:01:11,177 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0007_000001 (auth:SIMPLE) 2023-10-04 07:01:13,313 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696402773467_0007_000001 (auth:SIMPLE) 2023-10-04 07:01:13,324 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696402773467_0007_01_000002 is : 143 2023-10-04 07:01:14,527 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 07:01:14,527 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 07:01:14,538 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,538 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 07:01:14,538 INFO [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 07:01:14,539 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,539 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-04 07:01:14,539 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-04 07:01:14,539 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1733824560_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,540 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-04 07:01:14,540 DEBUG [Listener at jenkins-hbase20.apache.org/37865] snapshot.TestExportSnapshot(367): hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/export-test/export-1696402862169/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-04 07:01:14,547 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 07:01:14,551 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402874551"}]},"ts":"1696402874551"} 2023-10-04 07:01:14,552 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-04 07:01:14,553 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-04 07:01:14,554 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d543ae88dba4d6b70b47de68c578de5c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d50127926b1466b5d08d6617419eb463, UNASSIGN}] 2023-10-04 07:01:14,556 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d50127926b1466b5d08d6617419eb463, UNASSIGN 2023-10-04 07:01:14,556 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d543ae88dba4d6b70b47de68c578de5c, UNASSIGN 2023-10-04 07:01:14,556 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d50127926b1466b5d08d6617419eb463, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:14,556 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d543ae88dba4d6b70b47de68c578de5c, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:14,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402874556"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402874556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402874556"}]},"ts":"1696402874556"} 2023-10-04 07:01:14,557 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402874556"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696402874556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696402874556"}]},"ts":"1696402874556"} 2023-10-04 07:01:14,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure d50127926b1466b5d08d6617419eb463, server=jenkins-hbase20.apache.org,45271,1696402767235}] 2023-10-04 07:01:14,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure d543ae88dba4d6b70b47de68c578de5c, server=jenkins-hbase20.apache.org,44825,1696402767278}] 2023-10-04 07:01:14,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 07:01:14,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:14,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d50127926b1466b5d08d6617419eb463, disabling compactions & flushes 2023-10-04 07:01:14,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. after waiting 0 ms 2023-10-04 07:01:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d543ae88dba4d6b70b47de68c578de5c, disabling compactions & flushes 2023-10-04 07:01:14,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:14,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. after waiting 0 ms 2023-10-04 07:01:14,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:14,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:01:14,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:01:14,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:14,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:14,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c. 2023-10-04 07:01:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d543ae88dba4d6b70b47de68c578de5c: 2023-10-04 07:01:14,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463. 2023-10-04 07:01:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d50127926b1466b5d08d6617419eb463: 2023-10-04 07:01:14,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:14,733 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d50127926b1466b5d08d6617419eb463, regionState=CLOSED 2023-10-04 07:01:14,733 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402874733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402874733"}]},"ts":"1696402874733"} 2023-10-04 07:01:14,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:14,733 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d543ae88dba4d6b70b47de68c578de5c, regionState=CLOSED 2023-10-04 07:01:14,733 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696402874733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696402874733"}]},"ts":"1696402874733"} 2023-10-04 07:01:14,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-10-04 07:01:14,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure d50127926b1466b5d08d6617419eb463, server=jenkins-hbase20.apache.org,45271,1696402767235 in 176 msec 2023-10-04 07:01:14,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-10-04 07:01:14,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure d543ae88dba4d6b70b47de68c578de5c, server=jenkins-hbase20.apache.org,44825,1696402767278 in 177 msec 2023-10-04 07:01:14,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d50127926b1466b5d08d6617419eb463, UNASSIGN in 183 msec 2023-10-04 07:01:14,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-04 07:01:14,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d543ae88dba4d6b70b47de68c578de5c, UNASSIGN in 183 msec 2023-10-04 07:01:14,739 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696402874739"}]},"ts":"1696402874739"} 2023-10-04 07:01:14,741 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-04 07:01:14,742 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-04 07:01:14,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 195 msec 2023-10-04 07:01:14,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 07:01:14,856 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-04 07:01:14,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,865 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,866 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,867 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32841] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,869 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,869 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,869 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,869 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 07:01:14,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 07:01:14,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 07:01:14,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 07:01:14,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:14,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:14,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:14,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,871 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 07:01:14,871 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:14,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-04 07:01:14,871 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:14,874 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/recovered.edits] 2023-10-04 07:01:14,874 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf, FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/recovered.edits] 2023-10-04 07:01:14,879 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf/e56756f4a2604b5c82d2fac580c1deed to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/cf/e56756f4a2604b5c82d2fac580c1deed 2023-10-04 07:01:14,880 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf/db5b49d9cdde40b2828483057ee78d22 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/cf/db5b49d9cdde40b2828483057ee78d22 2023-10-04 07:01:14,882 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463/recovered.edits/9.seqid 2023-10-04 07:01:14,882 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/recovered.edits/9.seqid to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c/recovered.edits/9.seqid 2023-10-04 07:01:14,882 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d50127926b1466b5d08d6617419eb463 2023-10-04 07:01:14,882 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d543ae88dba4d6b70b47de68c578de5c 2023-10-04 07:01:14,882 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-04 07:01:14,883 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-04 07:01:14,884 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-04 07:01:14,886 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310045f500db4e1134ea3a16ea33d7fc2e341 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310045f500db4e1134ea3a16ea33d7fc2e341 2023-10-04 07:01:14,887 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100436422ef9335d43de9ee1ca46dbb3b279 to hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100436422ef9335d43de9ee1ca46dbb3b279 2023-10-04 07:01:14,888 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-04 07:01:14,890 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,892 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-04 07:01:14,893 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-04 07:01:14,894 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,895 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-04 07:01:14,895 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402874895"}]},"ts":"9223372036854775807"} 2023-10-04 07:01:14,895 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696402874895"}]},"ts":"9223372036854775807"} 2023-10-04 07:01:14,896 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 07:01:14,896 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d543ae88dba4d6b70b47de68c578de5c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696402860813.d543ae88dba4d6b70b47de68c578de5c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d50127926b1466b5d08d6617419eb463, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696402860813.d50127926b1466b5d08d6617419eb463.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 07:01:14,896 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-04 07:01:14,897 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696402874896"}]},"ts":"9223372036854775807"} 2023-10-04 07:01:14,898 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-04 07:01:14,899 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 40 msec 2023-10-04 07:01:14,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-04 07:01:14,973 INFO [Listener at jenkins-hbase20.apache.org/37865] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-04 07:01:14,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-04 07:01:14,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:14,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-04 07:01:14,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44183] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 07:01:15,007 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 765) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:39969 from appattempt_1696402773467_0007_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:60492 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2041579994_1 at /127.0.0.1:32940 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5331 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (490699419) connection to jenkins-hbase20.apache.org/148.251.75.209:35537 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:32968 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfd64be-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1733824560_17 at /127.0.0.1:47850 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2041579994_1 at /127.0.0.1:47832 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 282), ProcessCount=167 (was 167), AvailableMemoryMB=2233 (was 2246) 2023-10-04 07:01:15,007 WARN [Listener at jenkins-hbase20.apache.org/37865] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-04 07:01:15,007 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-04 07:01:15,019 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-04 07:01:15,136 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696402773467_0007_01_000001 is : 143 2023-10-04 07:01:20,299 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 07:01:29,157 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-04 07:01:43,288 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 07:01:43,290 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-04 07:01:43,403 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-04 07:01:43,413 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-04 07:01:43,414 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 07:01:43,421 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-04 07:01:43,525 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 07:01:43,525 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-04 07:01:43,525 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-04 07:01:43,526 INFO [Listener at jenkins-hbase20.apache.org/37865] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-04 07:01:43,526 DEBUG [Listener at jenkins-hbase20.apache.org/37865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x326622aa to 127.0.0.1:49707 2023-10-04 07:01:43,526 DEBUG [Listener at jenkins-hbase20.apache.org/37865] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:43,527 DEBUG [Listener at jenkins-hbase20.apache.org/37865] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-04 07:01:43,527 DEBUG [Listener at jenkins-hbase20.apache.org/37865] util.JVMClusterUtil(257): Found active master hash=262550661, stopped=false 2023-10-04 07:01:43,528 DEBUG [Listener at jenkins-hbase20.apache.org/37865] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:43,528 DEBUG [Listener at jenkins-hbase20.apache.org/37865] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 07:01:43,528 INFO [Listener at jenkins-hbase20.apache.org/37865] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 07:01:43,530 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 07:01:43,530 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 07:01:43,530 INFO [Listener at jenkins-hbase20.apache.org/37865] procedure2.ProcedureExecutor(628): Stopping 2023-10-04 07:01:43,530 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 07:01:43,530 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 07:01:43,530 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 07:01:43,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 07:01:43,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 07:01:43,530 DEBUG [Listener at jenkins-hbase20.apache.org/37865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a3e55e5 to 127.0.0.1:49707 2023-10-04 07:01:43,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 07:01:43,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 07:01:43,531 DEBUG [Listener at jenkins-hbase20.apache.org/37865] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:43,531 INFO [Listener at jenkins-hbase20.apache.org/37865] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,32841,1696402767186' ***** 2023-10-04 07:01:43,532 DEBUG [Listener at jenkins-hbase20.apache.org/37865] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:43,532 INFO [Listener at jenkins-hbase20.apache.org/37865] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 07:01:43,532 INFO [Listener at jenkins-hbase20.apache.org/37865] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,45271,1696402767235' ***** 2023-10-04 07:01:43,532 INFO [RS:0;jenkins-hbase20:32841] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 07:01:43,532 DEBUG [Listener at jenkins-hbase20.apache.org/37865] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:43,532 INFO [RS:0;jenkins-hbase20:32841] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 07:01:43,532 INFO [Listener at jenkins-hbase20.apache.org/37865] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 07:01:43,532 INFO [RS:0;jenkins-hbase20:32841] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 07:01:43,532 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 07:01:43,533 INFO [RS:1;jenkins-hbase20:45271] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 07:01:43,533 INFO [Listener at jenkins-hbase20.apache.org/37865] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44825,1696402767278' ***** 2023-10-04 07:01:43,533 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(3305): Received CLOSE for 15427b4f939a97260e6bd2e474ae1780 2023-10-04 07:01:43,533 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 07:01:43,533 INFO [RS:1;jenkins-hbase20:45271] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 07:01:43,533 DEBUG [Listener at jenkins-hbase20.apache.org/37865] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:43,533 INFO [RS:1;jenkins-hbase20:45271] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 07:01:43,533 INFO [Listener at jenkins-hbase20.apache.org/37865] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 07:01:43,533 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:43,533 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(3305): Received CLOSE for c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 07:01:43,533 DEBUG [RS:0;jenkins-hbase20:32841] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x624a9660 to 127.0.0.1:49707 2023-10-04 07:01:43,534 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:43,534 INFO [RS:2;jenkins-hbase20:44825] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 07:01:43,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 15427b4f939a97260e6bd2e474ae1780, disabling compactions & flushes 2023-10-04 07:01:43,535 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 07:01:43,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 07:01:43,535 INFO [RS:2;jenkins-hbase20:44825] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 07:01:43,535 DEBUG [RS:1;jenkins-hbase20:45271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17e06f7b to 127.0.0.1:49707 2023-10-04 07:01:43,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c2422e03be5de6fa3dc4c9321dd79a8e, disabling compactions & flushes 2023-10-04 07:01:43,534 DEBUG [RS:0;jenkins-hbase20:32841] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:43,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 07:01:43,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 07:01:43,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. after waiting 0 ms 2023-10-04 07:01:43,535 DEBUG [RS:1;jenkins-hbase20:45271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:43,535 INFO [RS:2;jenkins-hbase20:44825] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 07:01:43,537 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-04 07:01:43,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 07:01:43,538 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1478): Online Regions={c2422e03be5de6fa3dc4c9321dd79a8e=hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e.} 2023-10-04 07:01:43,537 INFO [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:43,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 07:01:43,536 INFO [RS:0;jenkins-hbase20:32841] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 07:01:43,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing c2422e03be5de6fa3dc4c9321dd79a8e 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-04 07:01:43,538 DEBUG [RS:2;jenkins-hbase20:44825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dd3451a to 127.0.0.1:49707 2023-10-04 07:01:43,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. after waiting 0 ms 2023-10-04 07:01:43,538 DEBUG [RS:2;jenkins-hbase20:44825] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:43,538 INFO [RS:0;jenkins-hbase20:32841] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 07:01:43,538 INFO [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44825,1696402767278; all regions closed. 2023-10-04 07:01:43,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 07:01:43,538 INFO [RS:0;jenkins-hbase20:32841] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 07:01:43,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 15427b4f939a97260e6bd2e474ae1780 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-04 07:01:43,539 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-04 07:01:43,539 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1504): Waiting on c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 07:01:43,539 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-04 07:01:43,539 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 15427b4f939a97260e6bd2e474ae1780=hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780.} 2023-10-04 07:01:43,540 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-04 07:01:43,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-04 07:01:43,540 DEBUG [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1504): Waiting on 15427b4f939a97260e6bd2e474ae1780, 1588230740 2023-10-04 07:01:43,540 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-04 07:01:43,540 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-04 07:01:43,540 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-04 07:01:43,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-10-04 07:01:43,549 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 07:01:43,549 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 07:01:43,549 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 07:01:43,561 DEBUG [RS:2;jenkins-hbase20:44825] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/oldWALs 2023-10-04 07:01:43,561 INFO [RS:2;jenkins-hbase20:44825] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44825%2C1696402767278:(num 1696402768787) 2023-10-04 07:01:43,562 DEBUG [RS:2;jenkins-hbase20:44825] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:43,562 INFO [RS:2;jenkins-hbase20:44825] regionserver.LeaseManager(133): Closed leases 2023-10-04 07:01:43,563 INFO [RS:2;jenkins-hbase20:44825] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-04 07:01:43,564 INFO [RS:2;jenkins-hbase20:44825] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 07:01:43,564 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 07:01:43,564 INFO [RS:2;jenkins-hbase20:44825] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 07:01:43,564 INFO [RS:2;jenkins-hbase20:44825] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 07:01:43,567 INFO [RS:2;jenkins-hbase20:44825] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44825 2023-10-04 07:01:43,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780/.tmp/l/1d9688352c444835acd99418755cbf65 2023-10-04 07:01:43,572 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/.tmp/info/0d7f62d7e0f94969b58efc48d9ffca25 2023-10-04 07:01:43,575 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:43,575 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:43,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 07:01:43,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 07:01:43,575 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44825,1696402767278 2023-10-04 07:01:43,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 07:01:43,576 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 07:01:43,576 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44825,1696402767278] 2023-10-04 07:01:43,577 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44825,1696402767278; numProcessing=1 2023-10-04 07:01:43,578 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44825,1696402767278 already deleted, retry=false 2023-10-04 07:01:43,578 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44825,1696402767278 expired; onlineServers=2 2023-10-04 07:01:43,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d9688352c444835acd99418755cbf65 2023-10-04 07:01:43,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d7f62d7e0f94969b58efc48d9ffca25 2023-10-04 07:01:43,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780/.tmp/l/1d9688352c444835acd99418755cbf65 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780/l/1d9688352c444835acd99418755cbf65 2023-10-04 07:01:43,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d9688352c444835acd99418755cbf65 2023-10-04 07:01:43,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780/l/1d9688352c444835acd99418755cbf65, entries=7, sequenceid=18, filesize=5.2 K 2023-10-04 07:01:43,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 15427b4f939a97260e6bd2e474ae1780 in 53ms, sequenceid=18, compaction requested=false 2023-10-04 07:01:43,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/acl/15427b4f939a97260e6bd2e474ae1780/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-04 07:01:43,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:43,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 07:01:43,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 15427b4f939a97260e6bd2e474ae1780: 2023-10-04 07:01:43,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696402770096.15427b4f939a97260e6bd2e474ae1780. 2023-10-04 07:01:43,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/.tmp/rep_barrier/79f0d0940ddc49ffb80bce2764229231 2023-10-04 07:01:43,619 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79f0d0940ddc49ffb80bce2764229231 2023-10-04 07:01:43,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/.tmp/table/27091c717e7b48dbb1bfb653d3bc2bd9 2023-10-04 07:01:43,633 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-04 07:01:43,633 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-04 07:01:43,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27091c717e7b48dbb1bfb653d3bc2bd9 2023-10-04 07:01:43,637 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/.tmp/info/0d7f62d7e0f94969b58efc48d9ffca25 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/info/0d7f62d7e0f94969b58efc48d9ffca25 2023-10-04 07:01:43,640 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-04 07:01:43,640 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-04 07:01:43,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d7f62d7e0f94969b58efc48d9ffca25 2023-10-04 07:01:43,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/info/0d7f62d7e0f94969b58efc48d9ffca25, entries=48, sequenceid=131, filesize=10.3 K 2023-10-04 07:01:43,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/.tmp/rep_barrier/79f0d0940ddc49ffb80bce2764229231 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/rep_barrier/79f0d0940ddc49ffb80bce2764229231 2023-10-04 07:01:43,649 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79f0d0940ddc49ffb80bce2764229231 2023-10-04 07:01:43,649 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/rep_barrier/79f0d0940ddc49ffb80bce2764229231, entries=13, sequenceid=131, filesize=6.4 K 2023-10-04 07:01:43,650 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/.tmp/table/27091c717e7b48dbb1bfb653d3bc2bd9 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/table/27091c717e7b48dbb1bfb653d3bc2bd9 2023-10-04 07:01:43,656 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27091c717e7b48dbb1bfb653d3bc2bd9 2023-10-04 07:01:43,656 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/table/27091c717e7b48dbb1bfb653d3bc2bd9, entries=24, sequenceid=131, filesize=6.9 K 2023-10-04 07:01:43,657 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 117ms, sequenceid=131, compaction requested=false 2023-10-04 07:01:43,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-04 07:01:43,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:43,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 07:01:43,672 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-04 07:01:43,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-04 07:01:43,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-04 07:01:43,677 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 07:01:43,677 INFO [RS:2;jenkins-hbase20:44825] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44825,1696402767278; zookeeper connection closed. 2023-10-04 07:01:43,677 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:44825-0x100fbbec6e50003, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 07:01:43,677 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@414a68c8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@414a68c8 2023-10-04 07:01:43,739 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1504): Waiting on c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 07:01:43,740 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,32841,1696402767186; all regions closed. 2023-10-04 07:01:43,745 DEBUG [RS:0;jenkins-hbase20:32841] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/oldWALs 2023-10-04 07:01:43,745 INFO [RS:0;jenkins-hbase20:32841] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C32841%2C1696402767186.meta:.meta(num 1696402769055) 2023-10-04 07:01:43,751 DEBUG [RS:0;jenkins-hbase20:32841] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/oldWALs 2023-10-04 07:01:43,751 INFO [RS:0;jenkins-hbase20:32841] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C32841%2C1696402767186:(num 1696402768786) 2023-10-04 07:01:43,751 DEBUG [RS:0;jenkins-hbase20:32841] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:43,751 INFO [RS:0;jenkins-hbase20:32841] regionserver.LeaseManager(133): Closed leases 2023-10-04 07:01:43,752 INFO [RS:0;jenkins-hbase20:32841] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-04 07:01:43,752 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 07:01:43,753 INFO [RS:0;jenkins-hbase20:32841] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:32841 2023-10-04 07:01:43,754 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:43,754 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32841,1696402767186 2023-10-04 07:01:43,754 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 07:01:43,755 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,32841,1696402767186] 2023-10-04 07:01:43,755 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,32841,1696402767186; numProcessing=2 2023-10-04 07:01:43,756 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,32841,1696402767186 already deleted, retry=false 2023-10-04 07:01:43,756 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,32841,1696402767186 expired; onlineServers=1 2023-10-04 07:01:43,855 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 07:01:43,856 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:32841-0x100fbbec6e50001, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 07:01:43,855 INFO [RS:0;jenkins-hbase20:32841] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,32841,1696402767186; zookeeper connection closed. 2023-10-04 07:01:43,856 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@50a95e26] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@50a95e26 2023-10-04 07:01:43,939 DEBUG [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1504): Waiting on c2422e03be5de6fa3dc4c9321dd79a8e 2023-10-04 07:01:43,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e/.tmp/info/6dc6f6b479c34672a9f64f3ed34a610b 2023-10-04 07:01:43,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e/.tmp/info/6dc6f6b479c34672a9f64f3ed34a610b as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e/info/6dc6f6b479c34672a9f64f3ed34a610b 2023-10-04 07:01:43,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e/info/6dc6f6b479c34672a9f64f3ed34a610b, entries=2, sequenceid=6, filesize=4.8 K 2023-10-04 07:01:43,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c2422e03be5de6fa3dc4c9321dd79a8e in 454ms, sequenceid=6, compaction requested=false 2023-10-04 07:01:43,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/data/hbase/namespace/c2422e03be5de6fa3dc4c9321dd79a8e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 07:01:43,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 07:01:43,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 07:01:43,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c2422e03be5de6fa3dc4c9321dd79a8e: 2023-10-04 07:01:43,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696402769330.c2422e03be5de6fa3dc4c9321dd79a8e. 2023-10-04 07:01:44,140 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,45271,1696402767235; all regions closed. 2023-10-04 07:01:44,151 DEBUG [RS:1;jenkins-hbase20:45271] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/oldWALs 2023-10-04 07:01:44,151 INFO [RS:1;jenkins-hbase20:45271] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C45271%2C1696402767235:(num 1696402768786) 2023-10-04 07:01:44,151 DEBUG [RS:1;jenkins-hbase20:45271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:44,151 INFO [RS:1;jenkins-hbase20:45271] regionserver.LeaseManager(133): Closed leases 2023-10-04 07:01:44,151 INFO [RS:1;jenkins-hbase20:45271] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-04 07:01:44,151 INFO [RS:1;jenkins-hbase20:45271] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 07:01:44,151 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 07:01:44,151 INFO [RS:1;jenkins-hbase20:45271] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 07:01:44,151 INFO [RS:1;jenkins-hbase20:45271] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 07:01:44,152 INFO [RS:1;jenkins-hbase20:45271] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:45271 2023-10-04 07:01:44,153 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,45271,1696402767235 2023-10-04 07:01:44,153 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 07:01:44,154 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,45271,1696402767235] 2023-10-04 07:01:44,154 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,45271,1696402767235; numProcessing=3 2023-10-04 07:01:44,155 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,45271,1696402767235 already deleted, retry=false 2023-10-04 07:01:44,155 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,45271,1696402767235 expired; onlineServers=0 2023-10-04 07:01:44,155 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44183,1696402766121' ***** 2023-10-04 07:01:44,155 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-04 07:01:44,155 DEBUG [M:0;jenkins-hbase20:44183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e9b3ebe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-04 07:01:44,155 INFO [M:0;jenkins-hbase20:44183] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44183,1696402766121 2023-10-04 07:01:44,155 INFO [M:0;jenkins-hbase20:44183] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44183,1696402766121; all regions closed. 2023-10-04 07:01:44,155 DEBUG [M:0;jenkins-hbase20:44183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 07:01:44,155 DEBUG [M:0;jenkins-hbase20:44183] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-04 07:01:44,155 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-04 07:01:44,155 DEBUG [M:0;jenkins-hbase20:44183] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-04 07:01:44,155 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696402768454] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696402768454,5,FailOnTimeoutGroup] 2023-10-04 07:01:44,155 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696402768454] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696402768454,5,FailOnTimeoutGroup] 2023-10-04 07:01:44,156 INFO [M:0;jenkins-hbase20:44183] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-04 07:01:44,156 INFO [M:0;jenkins-hbase20:44183] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-04 07:01:44,156 INFO [M:0;jenkins-hbase20:44183] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-10-04 07:01:44,156 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-04 07:01:44,156 DEBUG [M:0;jenkins-hbase20:44183] master.HMaster(1512): Stopping service threads 2023-10-04 07:01:44,156 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 07:01:44,156 INFO [M:0;jenkins-hbase20:44183] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-04 07:01:44,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 07:01:44,157 ERROR [M:0;jenkins-hbase20:44183] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-04 07:01:44,157 INFO [M:0;jenkins-hbase20:44183] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-04 07:01:44,157 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-04 07:01:44,158 DEBUG [M:0;jenkins-hbase20:44183] zookeeper.ZKUtil(398): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-04 07:01:44,158 WARN [M:0;jenkins-hbase20:44183] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-04 07:01:44,158 INFO [M:0;jenkins-hbase20:44183] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-04 07:01:44,158 INFO [M:0;jenkins-hbase20:44183] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-04 07:01:44,159 DEBUG [M:0;jenkins-hbase20:44183] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-04 07:01:44,159 INFO [M:0;jenkins-hbase20:44183] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 07:01:44,159 DEBUG [M:0;jenkins-hbase20:44183] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 07:01:44,159 DEBUG [M:0;jenkins-hbase20:44183] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-04 07:01:44,159 DEBUG [M:0;jenkins-hbase20:44183] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 07:01:44,159 INFO [M:0;jenkins-hbase20:44183] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.09 KB heapSize=452.34 KB 2023-10-04 07:01:44,171 INFO [M:0;jenkins-hbase20:44183] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.09 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fc6d0e916bad48fe92be31c7ce3c0953 2023-10-04 07:01:44,176 INFO [M:0;jenkins-hbase20:44183] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc6d0e916bad48fe92be31c7ce3c0953 2023-10-04 07:01:44,177 DEBUG [M:0;jenkins-hbase20:44183] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fc6d0e916bad48fe92be31c7ce3c0953 as hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fc6d0e916bad48fe92be31c7ce3c0953 2023-10-04 07:01:44,181 INFO [M:0;jenkins-hbase20:44183] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc6d0e916bad48fe92be31c7ce3c0953 2023-10-04 07:01:44,181 INFO [M:0;jenkins-hbase20:44183] regionserver.HStore(1080): Added hdfs://localhost:34823/user/jenkins/test-data/e2d597b2-ef0a-884f-8633-b936d89bc840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fc6d0e916bad48fe92be31c7ce3c0953, entries=119, sequenceid=899, filesize=28.6 K 2023-10-04 07:01:44,182 INFO [M:0;jenkins-hbase20:44183] regionserver.HRegion(2948): Finished flush of dataSize ~376.09 KB/385114, heapSize ~452.32 KB/463176, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-10-04 07:01:44,183 INFO [M:0;jenkins-hbase20:44183] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 07:01:44,183 DEBUG [M:0;jenkins-hbase20:44183] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 07:01:44,187 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 07:01:44,187 INFO [M:0;jenkins-hbase20:44183] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-04 07:01:44,188 INFO [M:0;jenkins-hbase20:44183] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44183 2023-10-04 07:01:44,191 DEBUG [M:0;jenkins-hbase20:44183] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44183,1696402766121 already deleted, retry=false 2023-10-04 07:01:44,254 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 07:01:44,255 INFO [RS:1;jenkins-hbase20:45271] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,45271,1696402767235; zookeeper connection closed. 2023-10-04 07:01:44,255 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): regionserver:45271-0x100fbbec6e50002, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 07:01:44,255 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3cb2e436] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3cb2e436 2023-10-04 07:01:44,255 INFO [Listener at jenkins-hbase20.apache.org/37865] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-04 07:01:44,355 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 07:01:44,355 DEBUG [Listener at localhost/37329-EventThread] zookeeper.ZKWatcher(600): master:44183-0x100fbbec6e50000, quorum=127.0.0.1:49707, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 07:01:44,355 INFO [M:0;jenkins-hbase20:44183] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44183,1696402766121; zookeeper connection closed. 2023-10-04 07:01:44,358 WARN [Listener at jenkins-hbase20.apache.org/37865] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 07:01:44,365 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 07:01:44,470 WARN [BP-1232773513-148.251.75.209-1696402762747 heartbeating to localhost/127.0.0.1:34823] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 07:01:44,470 WARN [BP-1232773513-148.251.75.209-1696402762747 heartbeating to localhost/127.0.0.1:34823] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1232773513-148.251.75.209-1696402762747 (Datanode Uuid 7263680a-f9bc-44ae-ac69-8b43e6938033) service to localhost/127.0.0.1:34823 2023-10-04 07:01:44,473 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data5/current/BP-1232773513-148.251.75.209-1696402762747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 07:01:44,473 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data6/current/BP-1232773513-148.251.75.209-1696402762747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 07:01:44,474 WARN [Listener at jenkins-hbase20.apache.org/37865] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 07:01:44,477 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 07:01:44,585 WARN [BP-1232773513-148.251.75.209-1696402762747 heartbeating to localhost/127.0.0.1:34823] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 07:01:44,585 WARN [BP-1232773513-148.251.75.209-1696402762747 heartbeating to localhost/127.0.0.1:34823] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1232773513-148.251.75.209-1696402762747 (Datanode Uuid 65e438af-b549-4691-ad27-1f0227586024) service to localhost/127.0.0.1:34823 2023-10-04 07:01:44,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data3/current/BP-1232773513-148.251.75.209-1696402762747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 07:01:44,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data4/current/BP-1232773513-148.251.75.209-1696402762747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 07:01:44,587 WARN [Listener at jenkins-hbase20.apache.org/37865] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 07:01:44,591 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 07:01:44,696 WARN [BP-1232773513-148.251.75.209-1696402762747 heartbeating to localhost/127.0.0.1:34823] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 07:01:44,696 WARN [BP-1232773513-148.251.75.209-1696402762747 heartbeating to localhost/127.0.0.1:34823] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1232773513-148.251.75.209-1696402762747 (Datanode Uuid 7948f1cb-ed9e-481a-acd9-bb0133918069) service to localhost/127.0.0.1:34823 2023-10-04 07:01:44,697 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data1/current/BP-1232773513-148.251.75.209-1696402762747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 07:01:44,698 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ea78f60-ce8e-6213-044d-587166fde2fb/cluster_a51596e1-780a-ceb8-a319-e0eeed3f6297/dfs/data/data2/current/BP-1232773513-148.251.75.209-1696402762747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 07:01:44,721 INFO [Listener at jenkins-hbase20.apache.org/37865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 07:01:44,850 INFO [Listener at jenkins-hbase20.apache.org/37865] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-04 07:01:44,934 INFO [Listener at jenkins-hbase20.apache.org/37865] hbase.HBaseTestingUtility(1293): Minicluster is down